2023-09-23T07:03:53.054 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-23T07:03:53.055 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi/7401660 --description rbd:cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/layering msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_support_module_recovery} --name rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi --owner scheduled_rraja@teuthology --verbose -- /home/teuthworker/archive/rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi/7401660/orig.config.yaml 2023-09-23T07:03:53.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T07:03:53.167 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi/7401660 branch: wip-62891 description: rbd:cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/layering msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_support_module_recovery} email: rraja@redhat.com first_in_suite: false job_id: '7401660' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-62891 ceph: conf: client: rbd default features: 1 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 debug rbd: 20 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: osd default pool size: 2 install: ceph: flavor: default sha1: ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62891 sha1: ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e owner: scheduled_rraja@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2241 sha1: ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e sleep_before_teardown: 0 suite: rbd:cli suite_branch: wip-62891 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e targets: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxp9AoIIUd8hfqm7nPyzdllxCuvyrnO6WADnHDNin/IwxbIReaZKP9sHLQ65wGcgStKzGEWxd15xhcr9t2tiCE= tasks: - install: null - ceph: null - install: extra_system_packages: - fio - workunit: clients: client.0: - rbd/rbd_support_module_recovery.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-23_06:37:41 tube: smithi user: rraja verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-23T07:03:53.167 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/qa; will attempt to use it 2023-09-23T07:03:53.168 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/qa/tasks 2023-09-23T07:03:53.168 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-23T07:03:53.169 INFO:teuthology.task.internal:Checking packages... 2023-09-23T07:03:53.192 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e' 2023-09-23T07:03:53.192 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-23T07:03:53.192 INFO:teuthology.packaging:ref: None 2023-09-23T07:03:53.192 INFO:teuthology.packaging:tag: None 2023-09-23T07:03:53.192 INFO:teuthology.packaging:branch: wip-62891 2023-09-23T07:03:53.192 INFO:teuthology.packaging:sha1: ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e 2023-09-23T07:03:53.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-62891 2023-09-23T07:03:53.334 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6334-gee696c23-1jammy 2023-09-23T07:03:53.334 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-23T07:03:53.341 INFO:teuthology.task.internal:no buildpackages task found 2023-09-23T07:03:53.341 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-23T07:03:53.348 INFO:teuthology.task.internal:Saving configuration 2023-09-23T07:03:53.359 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-23T07:03:53.364 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-23T07:03:53.390 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi/7401660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 06:58:09.840700', 'locked_by': 'scheduled_rraja@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINYnE8f6EnH1lLOAZqDTkVat5y1QO3qaP17qMEvolIrR'} 2023-09-23T07:03:53.390 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-23T07:03:53.396 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-09-23T07:03:53.396 INFO:teuthology.run_tasks:Running task console_log... 2023-09-23T07:03:53.436 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc533eb2af0>, signals=[15]) 2023-09-23T07:03:53.437 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-23T07:03:53.443 INFO:teuthology.task.internal:Opening connections... 2023-09-23T07:03:53.443 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2023-09-23T07:03:53.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T07:03:53.520 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-23T07:03:53.526 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-09-23T07:03:53.619 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-09-23T07:03:53.619 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-09-23T07:03:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-23T07:03:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2023-09-23T07:03:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2023-09-23T07:03:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-23T07:03:53.668 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2023-09-23T07:03:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2023-09-23T07:03:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2023-09-23T07:03:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-23T07:03:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-23T07:03:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-23T07:03:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-23T07:03:53.669 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2023-09-23T07:03:53.670 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-09-23T07:03:53.688 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-23T07:03:53.696 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-23T07:03:53.701 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-23T07:03:53.701 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2023-09-23T07:03:53.716 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-23T07:03:53.722 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-23T07:03:53.722 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2023-09-23T07:03:53.766 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-23T07:03:53.802 INFO:teuthology.run_tasks:Running task kernel... 2023-09-23T07:03:53.816 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-23T07:03:53.816 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-23T07:03:53.817 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-23T07:03:53.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T07:03:53.822 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2023-09-23T07:03:53.868 INFO:teuthology.orchestra.run.smithi107.stdout:5.15.0-56-generic 2023-09-23T07:03:53.869 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.15.0-56-generic 2023-09-23T07:03:53.869 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get clean 2023-09-23T07:03:53.992 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2023-09-23T07:03:54.288 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-23T07:03:54.291 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-09-23T07:03:54.347 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-09-23T07:03:54.699 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-09-23T07:03:54.704 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [328 kB] 2023-09-23T07:03:54.839 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [493 kB] 2023-09-23T07:03:54.967 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [802 kB] 2023-09-23T07:03:55.018 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,012 kB] 2023-09-23T07:03:55.108 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [169 kB] 2023-09-23T07:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.3 kB] 2023-09-23T07:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [882 kB] 2023-09-23T07:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [227 kB] 2023-09-23T07:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.6 kB] 2023-09-23T07:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [898 kB] 2023-09-23T07:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [30.0 kB] 2023-09-23T07:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [142 kB] 2023-09-23T07:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [536 B] 2023-09-23T07:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [785 kB] 2023-09-23T07:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [30.3 kB] 2023-09-23T07:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [145 kB] 2023-09-23T07:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [536 B] 2023-09-23T07:03:55.241 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [559 kB] 2023-09-23T07:03:55.381 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [984 kB] 2023-09-23T07:03:55.424 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [143 kB] 2023-09-23T07:03:55.805 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.7 kB] 2023-09-23T07:03:55.813 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-09-23T07:03:55.828 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-09-23T07:03:55.829 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-09-23T07:03:55.832 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-09-23T07:03:55.999 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [655 kB] 2023-09-23T07:03:56.037 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [215 kB] 2023-09-23T07:03:56.049 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [21.8 kB] 2023-09-23T07:03:56.050 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-09-23T07:03:56.051 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-09-23T07:03:56.053 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-09-23T07:03:56.053 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [476 B] 2023-09-23T07:03:56.054 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-09-23T07:03:56.055 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-09-23T07:03:56.082 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-09-23T07:03:56.246 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-09-23T07:03:56.329 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-09-23T07:03:56.334 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-09-23T07:03:56.453 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-09-23T07:03:56.505 INFO:teuthology.orchestra.run.smithi107.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-09-23T07:04:00.878 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 9,144 kB in 2s (3,772 kB/s) 2023-09-23T07:04:02.296 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2023-09-23T07:04:02.314 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-23T07:04:02.373 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2023-09-23T07:04:02.555 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2023-09-23T07:04:02.555 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2023-09-23T07:04:02.693 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2023-09-23T07:04:02.693 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-23T07:04:02.693 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-23T07:04:02.694 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-23T07:04:02.694 INFO:teuthology.orchestra.run.smithi107.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-09-23T07:04:02.694 INFO:teuthology.orchestra.run.smithi107.stdout: python2.7-minimal 2023-09-23T07:04:02.694 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-23T07:04:02.695 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2023-09-23T07:04:02.695 INFO:teuthology.orchestra.run.smithi107.stdout: linux-generic linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-09-23T07:04:02.695 INFO:teuthology.orchestra.run.smithi107.stdout: linux-headers-generic linux-image-5.15.0-84-generic 2023-09-23T07:04:02.695 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-5.15.0-84-generic linux-modules-extra-5.15.0-84-generic 2023-09-23T07:04:02.696 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2023-09-23T07:04:02.696 INFO:teuthology.orchestra.run.smithi107.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-09-23T07:04:02.696 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2023-09-23T07:04:02.696 INFO:teuthology.orchestra.run.smithi107.stdout: thermald 2023-09-23T07:04:02.743 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2023-09-23T07:04:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-09-23T07:04:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.15.0-84-generic linux-modules-5.15.0-84-generic 2023-09-23T07:04:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-extra-5.15.0-84-generic 2023-09-23T07:04:02.744 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages will be upgraded: 2023-09-23T07:04:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: linux-generic linux-headers-generic linux-image-generic 2023-09-23T07:04:02.800 INFO:teuthology.orchestra.run.smithi107.stdout:3 upgraded, 5 newly installed, 0 to remove and 265 not upgraded. 2023-09-23T07:04:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 113 MB of archives. 2023-09-23T07:04:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 582 MB of additional disk space will be used. 2023-09-23T07:04:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-84-generic amd64 5.15.0-84.93 [22.5 MB] 2023-09-23T07:04:03.472 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-84-generic amd64 5.15.0-84.93 [11.5 MB] 2023-09-23T07:04:03.678 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-84-generic amd64 5.15.0-84.93 [63.9 MB] 2023-09-23T07:04:05.489 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.84.81 [1,698 B] 2023-09-23T07:04:05.489 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.84.81 [2,476 B] 2023-09-23T07:04:05.490 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84 all 5.15.0-84.93 [12.3 MB] 2023-09-23T07:04:05.839 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84-generic amd64 5.15.0-84.93 [2,853 kB] 2023-09-23T07:04:05.909 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.84.81 [2,330 B] 2023-09-23T07:04:06.297 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 113 MB in 3s (35.8 MB/s) 2023-09-23T07:04:06.489 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-modules-5.15.0-84-generic. 2023-09-23T07:04:08.544 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-09-23T07:04:08.548 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../0-linux-modules-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-23T07:04:08.911 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-23T07:04:11.029 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-image-5.15.0-84-generic. 2023-09-23T07:04:11.050 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../1-linux-image-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-23T07:04:11.126 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-23T07:04:11.640 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-84-generic. 2023-09-23T07:04:11.660 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-23T07:04:11.698 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-23T07:04:18.656 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../3-linux-generic_5.15.0.84.81_amd64.deb ... 2023-09-23T07:04:18.784 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-09-23T07:04:19.142 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.84.81_amd64.deb ... 2023-09-23T07:04:19.271 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-09-23T07:04:19.590 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-headers-5.15.0-84. 2023-09-23T07:04:19.601 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../5-linux-headers-5.15.0-84_5.15.0-84.93_all.deb ... 2023-09-23T07:04:19.632 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-09-23T07:04:25.840 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-headers-5.15.0-84-generic. 2023-09-23T07:04:25.876 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../6-linux-headers-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-23T07:04:25.931 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-23T07:04:28.675 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.84.81_amd64.deb ... 2023-09-23T07:04:28.823 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-09-23T07:04:29.190 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-09-23T07:04:29.311 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-23T07:04:29.437 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-generic (5.15.0.84.81) ... 2023-09-23T07:04:29.608 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-23T07:04:31.517 INFO:teuthology.orchestra.run.smithi107.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-09-23T07:04:31.518 INFO:teuthology.orchestra.run.smithi107.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-09-23T07:04:31.518 INFO:teuthology.orchestra.run.smithi107.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-84-generic 2023-09-23T07:04:31.518 INFO:teuthology.orchestra.run.smithi107.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-84-generic 2023-09-23T07:04:31.701 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-23T07:04:33.119 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-23T07:04:34.553 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-generic (5.15.0.84.81) ... 2023-09-23T07:04:34.679 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-generic (5.15.0.84.81) ... 2023-09-23T07:04:34.830 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-23T07:04:34.894 INFO:teuthology.orchestra.run.smithi107.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-09-23T07:04:34.895 INFO:teuthology.orchestra.run.smithi107.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-84-generic 2023-09-23T07:04:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-09-23T07:04:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:Sourcing file `/etc/default/grub' 2023-09-23T07:04:49.272 INFO:teuthology.orchestra.run.smithi107.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-23T07:04:49.302 INFO:teuthology.orchestra.run.smithi107.stdout:Generating grub configuration file ... 2023-09-23T07:04:49.642 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-09-23T07:04:49.668 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-09-23T07:04:49.980 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-23T07:04:49.985 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-23T07:04:50.066 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-23T07:04:50.072 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-23T07:04:50.254 INFO:teuthology.orchestra.run.smithi107.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-23T07:04:50.255 INFO:teuthology.orchestra.run.smithi107.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-09-23T07:04:50.255 INFO:teuthology.orchestra.run.smithi107.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-23T07:04:50.295 INFO:teuthology.orchestra.run.smithi107.stdout:done 2023-09-23T07:04:50.806 DEBUG:teuthology.orchestra.run.smithi107:> dpkg -s linux-image-generic 2023-09-23T07:04:50.830 INFO:teuthology.orchestra.run.smithi107.stdout:Package: linux-image-generic 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Status: install ok installed 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Priority: optional 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Section: kernel 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Installed-Size: 20 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Maintainer: Ubuntu Kernel Team 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: amd64 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Source: linux-meta 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Version: 5.15.0.84.81 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-23T07:04:50.831 INFO:teuthology.orchestra.run.smithi107.stdout:Recommends: thermald 2023-09-23T07:04:50.832 INFO:teuthology.orchestra.run.smithi107.stdout:Description: Generic Linux kernel image 2023-09-23T07:04:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: This package will always depend on the latest generic kernel image 2023-09-23T07:04:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: available. 2023-09-23T07:04:50.832 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-84-generic 2023-09-23T07:04:50.832 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-23T07:04:50.832 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-23T07:04:50.832 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-09-23T07:04:50.832 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2023-09-23T07:04:50.833 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get clean 2023-09-23T07:04:50.983 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2023-09-23T07:04:51.096 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-23T07:04:51.096 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-23T07:04:51.105 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-23T07:04:51.122 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-23T07:04:52.412 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2023-09-23T07:04:52.429 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-23T07:04:52.489 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2023-09-23T07:04:52.673 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2023-09-23T07:04:52.674 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2023-09-23T07:04:52.833 INFO:teuthology.orchestra.run.smithi107.stdout:linux-image-generic is already the newest version (5.15.0.84.81). 2023-09-23T07:04:52.834 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2023-09-23T07:04:52.834 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-23T07:04:52.834 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-23T07:04:52.834 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-23T07:04:52.835 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-23T07:04:52.835 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-23T07:04:52.835 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-23T07:04:52.871 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 0 newly installed, 0 to remove and 265 not upgraded. 2023-09-23T07:04:52.873 DEBUG:teuthology.orchestra.run.smithi107:> dpkg -s linux-image-generic 2023-09-23T07:04:52.885 INFO:teuthology.orchestra.run.smithi107.stdout:Package: linux-image-generic 2023-09-23T07:04:52.885 INFO:teuthology.orchestra.run.smithi107.stdout:Status: install ok installed 2023-09-23T07:04:52.885 INFO:teuthology.orchestra.run.smithi107.stdout:Priority: optional 2023-09-23T07:04:52.885 INFO:teuthology.orchestra.run.smithi107.stdout:Section: kernel 2023-09-23T07:04:52.885 INFO:teuthology.orchestra.run.smithi107.stdout:Installed-Size: 20 2023-09-23T07:04:52.886 INFO:teuthology.orchestra.run.smithi107.stdout:Maintainer: Ubuntu Kernel Team 2023-09-23T07:04:52.886 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: amd64 2023-09-23T07:04:52.886 INFO:teuthology.orchestra.run.smithi107.stdout:Source: linux-meta 2023-09-23T07:04:52.886 INFO:teuthology.orchestra.run.smithi107.stdout:Version: 5.15.0.84.81 2023-09-23T07:04:52.886 INFO:teuthology.orchestra.run.smithi107.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-09-23T07:04:52.886 INFO:teuthology.orchestra.run.smithi107.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-23T07:04:52.886 INFO:teuthology.orchestra.run.smithi107.stdout:Recommends: thermald 2023-09-23T07:04:52.886 INFO:teuthology.orchestra.run.smithi107.stdout:Description: Generic Linux kernel image 2023-09-23T07:04:52.886 INFO:teuthology.orchestra.run.smithi107.stdout: This package will always depend on the latest generic kernel image 2023-09-23T07:04:52.887 INFO:teuthology.orchestra.run.smithi107.stdout: available. 2023-09-23T07:04:52.887 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2023-09-23T07:04:52.931 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.DusfXF8vQR 2023-09-23T07:04:52.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub/grub.cfg /tmp/tmp.DusfXF8vQR 2023-09-23T07:04:52.993 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.DusfXF8vQR 2023-09-23T07:04:53.116 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.DusfXF8vQR is 10KB 2023-09-23T07:04:53.129 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.DusfXF8vQR 2023-09-23T07:04:53.134 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-09-23T07:04:53.187 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:04:53.187 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-09-23T07:04:53.187 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-09-23T07:04:53.266 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-84-generic 2023-09-23T07:04:53.267 DEBUG:teuthology.orchestra.run.smithi107:> sudo update-grub 2023-09-23T07:04:54.579 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub' 2023-09-23T07:04:54.580 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-23T07:04:54.584 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2023-09-23T07:04:54.765 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-09-23T07:04:54.770 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-09-23T07:04:55.058 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-23T07:04:55.063 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-23T07:04:55.103 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-23T07:04:55.108 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-23T07:04:55.227 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-23T07:04:55.227 INFO:teuthology.orchestra.run.smithi107.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-09-23T07:04:55.227 INFO:teuthology.orchestra.run.smithi107.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-23T07:04:55.237 INFO:teuthology.orchestra.run.smithi107.stderr:done 2023-09-23T07:04:55.239 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2023-09-23T07:05:25.270 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-23T07:05:25.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-09-23T07:05:25.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T07:05:43.802 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-23T07:05:52.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-09-23T07:05:52.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T07:05:55.866 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-23T07:06:07.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-09-23T07:06:07.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T07:06:26.298 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-09-23T07:06:41.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-09-23T07:06:41.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T07:06:41.770 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-09-23T07:06:42.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-09-23T07:06:42.581 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-84-generic"... 2023-09-23T07:06:42.581 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2023-09-23T07:06:42.631 INFO:teuthology.orchestra.run.smithi107.stdout:5.15.0-84-generic 2023-09-23T07:06:42.631 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-84-generic vs 5.15.0-84-generic 2023-09-23T07:06:42.631 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-23T07:06:42.631 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-23T07:06:43.632 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-23T07:06:43.633 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-23T07:06:43.836 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2023-09-23T07:06:43.864 DEBUG:teuthology.parallel:result is None 2023-09-23T07:06:43.865 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-23T07:06:43.871 INFO:teuthology.task.internal:Creating test directory... 2023-09-23T07:06:43.871 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-23T07:06:43.877 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-23T07:06:43.884 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-23T07:06:43.892 INFO:teuthology.task.internal:Creating archive directory... 2023-09-23T07:06:43.892 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-23T07:06:44.003 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-23T07:06:44.010 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-23T07:06:44.011 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-23T07:06:44.028 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-23T07:06:44.034 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-23T07:06:44.035 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-23T07:06:44.043 INFO:teuthology.task.internal:Configuring sudo... 2023-09-23T07:06:44.043 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-23T07:06:44.088 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-23T07:06:44.097 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-23T07:06:44.097 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-23T07:06:44.134 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-23T07:06:44.183 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-23T07:06:44.235 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:06:44.235 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-23T07:06:44.306 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2023-09-23T07:06:44.416 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-23T07:06:44.424 INFO:teuthology.task.internal:Starting timer... 2023-09-23T07:06:44.424 INFO:teuthology.run_tasks:Running task pcp... 2023-09-23T07:06:44.434 INFO:teuthology.run_tasks:Running task selinux... 2023-09-23T07:06:44.442 DEBUG:teuthology.task.selinux:Excluding smithi107: OS 'ubuntu' does not support SELinux 2023-09-23T07:06:44.442 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-23T07:06:44.443 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-09-23T07:06:44.443 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-23T07:06:44.443 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-23T07:06:44.451 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-09-23T07:06:44.451 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-23T07:06:44.465 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-23T07:06:44.467 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-23T07:14:19.570 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2023-09-23T07:14:19.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-09-23T07:14:19.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-23T07:14:19.650 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-09-23T07:14:19.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-09-23T07:14:19.750 INFO:teuthology.run_tasks:Running task clock... 2023-09-23T07:14:19.759 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-23T07:14:19.760 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-23T07:14:19.760 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-23T07:14:19.821 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-09-23T07:14:19.821 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: Command line: ntpd -gq 2023-09-23T07:14:19.821 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: ---------------------------------------------------- 2023-09-23T07:14:19.821 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: ntp-4 is maintained by Network Time Foundation, 2023-09-23T07:14:19.822 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-09-23T07:14:19.822 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: corporation. Support and training for ntp-4 are 2023-09-23T07:14:19.822 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: available at https://www.nwtime.org/support 2023-09-23T07:14:19.822 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: ---------------------------------------------------- 2023-09-23T07:14:19.823 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: proto: precision = 0.043 usec (-24) 2023-09-23T07:14:19.823 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: basedate set to 2022-02-04 2023-09-23T07:14:19.823 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: gps base set to 2022-02-06 (week 2196) 2023-09-23T07:14:19.823 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-23T07:14:19.823 INFO:teuthology.orchestra.run.smithi107.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-23T07:14:19.823 INFO:teuthology.orchestra.run.smithi107.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-23T07:14:19.824 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: restrict ::: KOD does nothing without LIMITED. 2023-09-23T07:14:19.824 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: Listen and drop on 0 v6wildcard [::]:123 2023-09-23T07:14:19.825 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-23T07:14:19.825 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: Listen normally on 2 lo 127.0.0.1:123 2023-09-23T07:14:19.825 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: Listen normally on 3 enp3s0f1 172.21.15.107:123 2023-09-23T07:14:19.825 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: Listen normally on 4 lo [::1]:123 2023-09-23T07:14:19.825 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:47eb%5]:123 2023-09-23T07:14:19.825 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:19 ntpd[27856]: Listening on routing socket on fd #22 for interface updates 2023-09-23T07:14:21.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:21 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:21.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:21 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:23.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-23T07:14:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: can't open /var/log/ntpstats/peerstats.20230923: Permission denied 2023-09-23T07:14:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-23T07:14:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:23 ntpd[27856]: can't open /var/log/ntpstats/peerstats.20230923: Permission denied 2023-09-23T07:14:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:24 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:24 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:24 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:24 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:24.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:24 ntpd[27856]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-23T07:14:24.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:24 ntpd[27856]: can't open /var/log/ntpstats/peerstats.20230923: Permission denied 2023-09-23T07:14:25.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:25.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:25.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:25.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:25.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:25.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:25.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-23T07:14:25.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: can't open /var/log/ntpstats/peerstats.20230923: Permission denied 2023-09-23T07:14:25.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:25.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:25.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-23T07:14:25.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:25 ntpd[27856]: can't open /var/log/ntpstats/peerstats.20230923: Permission denied 2023-09-23T07:14:26.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:26 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:26.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:26 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:26.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:26 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:26.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:26 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:26.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:26 ntpd[27856]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-23T07:14:26.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:26 ntpd[27856]: can't open /var/log/ntpstats/peerstats.20230923: Permission denied 2023-09-23T07:14:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-23T07:14:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: can't open /var/log/ntpstats/peerstats.20230923: Permission denied 2023-09-23T07:14:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:27.824 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-23T07:14:27.824 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:27 ntpd[27856]: can't open /var/log/ntpstats/peerstats.20230923: Permission denied 2023-09-23T07:14:28.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:28 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:28.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:28 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:28.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:28 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:28.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:28 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:28.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:28 ntpd[27856]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-23T07:14:28.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:28 ntpd[27856]: can't open /var/log/ntpstats/peerstats.20230923: Permission denied 2023-09-23T07:14:29.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:29 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:29.822 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:29 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:29.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:29 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:29.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:29 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:29.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:29 ntpd[27856]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-23T07:14:29.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:29 ntpd[27856]: can't open /var/log/ntpstats/rawstats.20230923: Permission denied 2023-09-23T07:14:29.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:29 ntpd[27856]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-23T07:14:29.823 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:29 ntpd[27856]: can't open /var/log/ntpstats/peerstats.20230923: Permission denied 2023-09-23T07:14:29.823 INFO:teuthology.orchestra.run.smithi107.stdout:23 Sep 07:14:29 ntpd[27856]: ntpd: time slew +0.000581 s 2023-09-23T07:14:29.823 INFO:teuthology.orchestra.run.smithi107.stdout:ntpd: time slew +0.000581s 2023-09-23T07:14:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:29 ntpd[27856]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-23T07:14:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:23 Sep 07:14:29 ntpd[27856]: can't open /var/log/ntpstats/loopstats.20230923: Permission denied 2023-09-23T07:14:29.903 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2023-09-23T07:14:29.903 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2023-09-23T07:14:29.903 INFO:teuthology.orchestra.run.smithi107.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-23T07:14:29.903 INFO:teuthology.orchestra.run.smithi107.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-23T07:14:29.903 INFO:teuthology.orchestra.run.smithi107.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-23T07:14:29.903 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-23T07:14:29.904 INFO:teuthology.run_tasks:Running task install... 2023-09-23T07:14:29.912 DEBUG:teuthology.task.install:project ceph 2023-09-23T07:14:29.912 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e'}} 2023-09-23T07:14:29.912 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e'} 2023-09-23T07:14:29.913 INFO:teuthology.task.install:Using flavor: default 2023-09-23T07:14:29.918 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-23T07:14:29.919 INFO:teuthology.task.install:extra packages: [] 2023-09-23T07:14:29.919 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-key list | grep Ceph 2023-09-23T07:14:30.001 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-09-23T07:14:30.028 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-23T07:14:30.029 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph.com (release key) 2023-09-23T07:14:30.029 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-09-23T07:14:30.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e 2023-09-23T07:14:30.299 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default/ 2023-09-23T07:14:30.299 INFO:teuthology.task.install.deb:Package version is 18.0.0-6334-gee696c23-1jammy 2023-09-23T07:14:30.677 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:14:30.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-23T07:14:30.691 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2023-09-23T07:14:31.068 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-23T07:14:31.068 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-23T07:14:31.139 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-23T07:14:31.175 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy InRelease 2023-09-23T07:14:31.221 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-23T07:14:31.244 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-09-23T07:14:31.338 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy Release.gpg 2023-09-23T07:14:31.422 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2023-09-23T07:14:31.520 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-09-23T07:14:31.616 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 28.6 kB in 1s (39.2 kB/s) 2023-09-23T07:14:32.501 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2023-09-23T07:14:32.517 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6334-gee696c23-1jammy cephadm=18.0.0-6334-gee696c23-1jammy ceph-mds=18.0.0-6334-gee696c23-1jammy ceph-mgr=18.0.0-6334-gee696c23-1jammy ceph-common=18.0.0-6334-gee696c23-1jammy ceph-fuse=18.0.0-6334-gee696c23-1jammy ceph-test=18.0.0-6334-gee696c23-1jammy ceph-volume=18.0.0-6334-gee696c23-1jammy radosgw=18.0.0-6334-gee696c23-1jammy python3-rados=18.0.0-6334-gee696c23-1jammy python3-rgw=18.0.0-6334-gee696c23-1jammy python3-cephfs=18.0.0-6334-gee696c23-1jammy python3-rbd=18.0.0-6334-gee696c23-1jammy libcephfs2=18.0.0-6334-gee696c23-1jammy libcephfs-dev=18.0.0-6334-gee696c23-1jammy librados2=18.0.0-6334-gee696c23-1jammy librbd1=18.0.0-6334-gee696c23-1jammy rbd-fuse=18.0.0-6334-gee696c23-1jammy 2023-09-23T07:14:32.579 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2023-09-23T07:14:32.757 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2023-09-23T07:14:32.758 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2023-09-23T07:14:32.926 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2023-09-23T07:14:32.926 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-23T07:14:32.926 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-23T07:14:32.926 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-23T07:14:32.926 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-23T07:14:32.926 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-23T07:14:32.926 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-23T07:14:32.928 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2023-09-23T07:14:32.928 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-23T07:14:32.928 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-09-23T07:14:32.928 INFO:teuthology.orchestra.run.smithi107.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-23T07:14:32.929 INFO:teuthology.orchestra.run.smithi107.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-09-23T07:14:32.929 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-09-23T07:14:32.929 INFO:teuthology.orchestra.run.smithi107.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-09-23T07:14:32.929 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-09-23T07:14:32.929 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-09-23T07:14:32.929 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2023-09-23T07:14:32.929 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-09-23T07:14:32.929 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-09-23T07:14:32.930 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2023-09-23T07:14:32.931 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2023-09-23T07:14:32.931 INFO:teuthology.orchestra.run.smithi107.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-09-23T07:14:32.931 INFO:teuthology.orchestra.run.smithi107.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-09-23T07:14:32.931 INFO:teuthology.orchestra.run.smithi107.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-09-23T07:14:32.931 INFO:teuthology.orchestra.run.smithi107.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-09-23T07:14:32.932 INFO:teuthology.orchestra.run.smithi107.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-09-23T07:14:32.932 INFO:teuthology.orchestra.run.smithi107.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-09-23T07:14:32.932 INFO:teuthology.orchestra.run.smithi107.stdout: python3-watchdog 2023-09-23T07:14:32.932 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2023-09-23T07:14:32.932 INFO:teuthology.orchestra.run.smithi107.stdout: btrfs-tools 2023-09-23T07:14:33.029 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2023-09-23T07:14:33.029 INFO:teuthology.orchestra.run.smithi107.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-23T07:14:33.030 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-23T07:14:33.030 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2023-09-23T07:14:33.030 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2023-09-23T07:14:33.030 INFO:teuthology.orchestra.run.smithi107.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2023-09-23T07:14:33.030 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-09-23T07:14:33.030 INFO:teuthology.orchestra.run.smithi107.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-09-23T07:14:33.030 INFO:teuthology.orchestra.run.smithi107.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-09-23T07:14:33.030 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-09-23T07:14:33.030 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2023-09-23T07:14:33.031 INFO:teuthology.orchestra.run.smithi107.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-09-23T07:14:33.031 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-09-23T07:14:33.031 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-09-23T07:14:33.031 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-09-23T07:14:33.031 INFO:teuthology.orchestra.run.smithi107.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-23T07:14:33.031 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-09-23T07:14:33.031 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-09-23T07:14:33.031 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2023-09-23T07:14:33.031 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-09-23T07:14:33.032 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-23T07:14:33.032 INFO:teuthology.orchestra.run.smithi107.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-09-23T07:14:33.032 INFO:teuthology.orchestra.run.smithi107.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-09-23T07:14:33.032 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-09-23T07:14:33.032 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-09-23T07:14:33.032 INFO:teuthology.orchestra.run.smithi107.stdout: socat xmlstarlet 2023-09-23T07:14:33.216 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 109 newly installed, 0 to remove and 253 not upgraded. 2023-09-23T07:14:33.217 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 183 MB of archives. 2023-09-23T07:14:33.217 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 823 MB of additional disk space will be used. 2023-09-23T07:14:33.217 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-09-23T07:14:33.492 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-09-23T07:14:33.507 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6334-gee696c23-1jammy [3,438 kB] 2023-09-23T07:14:33.665 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-09-23T07:14:33.679 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-09-23T07:14:33.752 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-09-23T07:14:33.950 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-09-23T07:14:33.958 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-09-23T07:14:33.986 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-09-23T07:14:33.994 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-09-23T07:14:33.995 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-09-23T07:14:33.997 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-09-23T07:14:34.178 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-09-23T07:14:34.390 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-09-23T07:14:34.403 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-09-23T07:14:34.521 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-09-23T07:14:34.529 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-09-23T07:14:34.540 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-09-23T07:14:34.556 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-09-23T07:14:34.570 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-09-23T07:14:34.575 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-09-23T07:14:34.579 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-09-23T07:14:34.681 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-09-23T07:14:34.856 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-09-23T07:14:35.023 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-09-23T07:14:35.045 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-09-23T07:14:35.179 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-23T07:14:35.196 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-09-23T07:14:35.204 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-09-23T07:14:35.204 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6334-gee696c23-1jammy [3,120 kB] 2023-09-23T07:14:35.277 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-09-23T07:14:35.304 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-09-23T07:14:35.312 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-09-23T07:14:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-09-23T07:14:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-09-23T07:14:35.604 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-09-23T07:14:35.795 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-09-23T07:14:35.951 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-09-23T07:14:35.955 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6334-gee696c23-1jammy [677 kB] 2023-09-23T07:14:36.057 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-09-23T07:14:36.079 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-09-23T07:14:36.110 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-09-23T07:14:36.123 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-09-23T07:14:36.130 INFO:teuthology.orchestra.run.smithi107.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6334-gee696c23-1jammy [345 kB] 2023-09-23T07:14:36.137 INFO:teuthology.orchestra.run.smithi107.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6334-gee696c23-1jammy [22.9 kB] 2023-09-23T07:14:36.139 INFO:teuthology.orchestra.run.smithi107.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6334-gee696c23-1jammy [170 kB] 2023-09-23T07:14:36.164 INFO:teuthology.orchestra.run.smithi107.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-09-23T07:14:36.173 INFO:teuthology.orchestra.run.smithi107.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-09-23T07:14:36.202 INFO:teuthology.orchestra.run.smithi107.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-09-23T07:14:36.228 INFO:teuthology.orchestra.run.smithi107.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6334-gee696c23-1jammy [52.4 kB] 2023-09-23T07:14:36.230 INFO:teuthology.orchestra.run.smithi107.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6334-gee696c23-1jammy [318 kB] 2023-09-23T07:14:36.237 INFO:teuthology.orchestra.run.smithi107.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6334-gee696c23-1jammy [6,201 kB] 2023-09-23T07:14:36.442 INFO:teuthology.orchestra.run.smithi107.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-09-23T07:14:36.607 INFO:teuthology.orchestra.run.smithi107.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-09-23T07:14:36.856 INFO:teuthology.orchestra.run.smithi107.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6334-gee696c23-1jammy [102 kB] 2023-09-23T07:14:36.858 INFO:teuthology.orchestra.run.smithi107.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6334-gee696c23-1jammy [428 kB] 2023-09-23T07:14:36.887 INFO:teuthology.orchestra.run.smithi107.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6334-gee696c23-1jammy [22.5 MB] 2023-09-23T07:14:36.955 INFO:teuthology.orchestra.run.smithi107.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-09-23T07:14:36.972 INFO:teuthology.orchestra.run.smithi107.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-23T07:14:36.980 INFO:teuthology.orchestra.run.smithi107.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-09-23T07:14:37.043 INFO:teuthology.orchestra.run.smithi107.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-09-23T07:14:37.338 INFO:teuthology.orchestra.run.smithi107.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-09-23T07:14:37.348 INFO:teuthology.orchestra.run.smithi107.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-09-23T07:14:37.349 INFO:teuthology.orchestra.run.smithi107.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-09-23T07:14:37.414 INFO:teuthology.orchestra.run.smithi107.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-09-23T07:14:37.415 INFO:teuthology.orchestra.run.smithi107.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-09-23T07:14:37.417 INFO:teuthology.orchestra.run.smithi107.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-09-23T07:14:37.582 INFO:teuthology.orchestra.run.smithi107.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-09-23T07:14:37.773 INFO:teuthology.orchestra.run.smithi107.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-09-23T07:14:37.836 INFO:teuthology.orchestra.run.smithi107.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-09-23T07:14:37.871 INFO:teuthology.orchestra.run.smithi107.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-09-23T07:14:37.930 INFO:teuthology.orchestra.run.smithi107.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-09-23T07:14:38.049 INFO:teuthology.orchestra.run.smithi107.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6334-gee696c23-1jammy [6,841 kB] 2023-09-23T07:14:38.101 INFO:teuthology.orchestra.run.smithi107.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-09-23T07:14:38.140 INFO:teuthology.orchestra.run.smithi107.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-09-23T07:14:38.164 INFO:teuthology.orchestra.run.smithi107.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-09-23T07:14:38.171 INFO:teuthology.orchestra.run.smithi107.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-09-23T07:14:38.213 INFO:teuthology.orchestra.run.smithi107.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-09-23T07:14:38.222 INFO:teuthology.orchestra.run.smithi107.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6334-gee696c23-1jammy [228 kB] 2023-09-23T07:14:38.226 INFO:teuthology.orchestra.run.smithi107.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6334-gee696c23-1jammy [117 kB] 2023-09-23T07:14:38.229 INFO:teuthology.orchestra.run.smithi107.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6334-gee696c23-1jammy [1,486 kB] 2023-09-23T07:14:38.236 INFO:teuthology.orchestra.run.smithi107.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-09-23T07:14:38.275 INFO:teuthology.orchestra.run.smithi107.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6334-gee696c23-1jammy [9,851 kB] 2023-09-23T07:14:38.434 INFO:teuthology.orchestra.run.smithi107.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-09-23T07:14:38.595 INFO:teuthology.orchestra.run.smithi107.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6334-gee696c23-1jammy [31.7 MB] 2023-09-23T07:14:38.915 INFO:teuthology.orchestra.run.smithi107.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-09-23T07:14:38.916 INFO:teuthology.orchestra.run.smithi107.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-23T07:14:38.927 INFO:teuthology.orchestra.run.smithi107.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-09-23T07:14:38.930 INFO:teuthology.orchestra.run.smithi107.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-09-23T07:14:38.960 INFO:teuthology.orchestra.run.smithi107.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-09-23T07:14:38.974 INFO:teuthology.orchestra.run.smithi107.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-09-23T07:14:39.101 INFO:teuthology.orchestra.run.smithi107.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-09-23T07:14:39.102 INFO:teuthology.orchestra.run.smithi107.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-09-23T07:14:39.104 INFO:teuthology.orchestra.run.smithi107.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-09-23T07:14:39.122 INFO:teuthology.orchestra.run.smithi107.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-09-23T07:14:39.290 INFO:teuthology.orchestra.run.smithi107.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-09-23T07:14:39.819 INFO:teuthology.orchestra.run.smithi107.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6334-gee696c23-1jammy [3,594 B] 2023-09-23T07:14:39.819 INFO:teuthology.orchestra.run.smithi107.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6334-gee696c23-1jammy [827 kB] 2023-09-23T07:14:39.836 INFO:teuthology.orchestra.run.smithi107.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6334-gee696c23-1jammy [2,135 kB] 2023-09-23T07:14:39.873 INFO:teuthology.orchestra.run.smithi107.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6334-gee696c23-1jammy [251 kB] 2023-09-23T07:14:39.877 INFO:teuthology.orchestra.run.smithi107.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6334-gee696c23-1jammy [128 kB] 2023-09-23T07:14:39.879 INFO:teuthology.orchestra.run.smithi107.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6334-gee696c23-1jammy [1,883 kB] 2023-09-23T07:14:39.942 INFO:teuthology.orchestra.run.smithi107.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6334-gee696c23-1jammy [8,615 kB] 2023-09-23T07:14:40.294 INFO:teuthology.orchestra.run.smithi107.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6334-gee696c23-1jammy [3,724 B] 2023-09-23T07:14:40.294 INFO:teuthology.orchestra.run.smithi107.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6334-gee696c23-1jammy [47.7 MB] 2023-09-23T07:14:42.131 INFO:teuthology.orchestra.run.smithi107.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6334-gee696c23-1jammy [234 kB] 2023-09-23T07:14:42.135 INFO:teuthology.orchestra.run.smithi107.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6334-gee696c23-1jammy [28.3 kB] 2023-09-23T07:14:42.136 INFO:teuthology.orchestra.run.smithi107.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6334-gee696c23-1jammy [12.3 MB] 2023-09-23T07:14:42.537 INFO:teuthology.orchestra.run.smithi107.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6334-gee696c23-1jammy [80.6 kB] 2023-09-23T07:14:43.081 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 183 MB in 10s (19.3 MB/s) 2023-09-23T07:14:43.218 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libfmt8:amd64. 2023-09-23T07:14:43.305 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 166009 files and directories currently installed.) 2023-09-23T07:14:43.310 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-09-23T07:14:43.392 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-23T07:14:43.788 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-09-23T07:14:43.814 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-09-23T07:14:43.862 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-23T07:14:44.308 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-23T07:14:44.334 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-09-23T07:14:44.382 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-23T07:14:44.719 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-23T07:14:44.745 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-09-23T07:14:44.785 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-23T07:14:45.173 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-23T07:14:45.199 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-23T07:14:45.247 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-23T07:14:45.668 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-23T07:14:45.694 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-23T07:14:45.734 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-23T07:14:46.054 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-23T07:14:46.080 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-23T07:14:46.121 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-23T07:14:46.457 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-09-23T07:14:46.483 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-09-23T07:14:46.524 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-23T07:14:46.844 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librados2. 2023-09-23T07:14:46.870 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../008-librados2_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:46.910 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librados2 (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:47.338 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librbd1. 2023-09-23T07:14:47.361 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../009-librbd1_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:47.396 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librbd1 (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:47.824 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs2. 2023-09-23T07:14:47.851 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../010-libcephfs2_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:47.891 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs2 (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:48.185 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rados. 2023-09-23T07:14:48.211 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../011-python3-rados_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:48.252 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rados (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:48.638 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-23T07:14:48.664 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.0.0-6334-gee696c23-1jammy_all.deb ... 2023-09-23T07:14:48.713 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-argparse (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:49.016 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cephfs. 2023-09-23T07:14:49.031 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../013-python3-cephfs_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:49.082 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cephfs (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:49.419 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-23T07:14:49.445 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../014-python3-ceph-common_18.0.0-6334-gee696c23-1jammy_all.deb ... 2023-09-23T07:14:49.485 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-common (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:49.772 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-23T07:14:49.798 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-09-23T07:14:49.830 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-23T07:14:50.133 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-prettytable. 2023-09-23T07:14:50.160 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2023-09-23T07:14:50.200 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-09-23T07:14:50.461 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rbd. 2023-09-23T07:14:50.476 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../017-python3-rbd_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:50.519 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rbd (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:50.872 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-23T07:14:50.899 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-09-23T07:14:50.964 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-23T07:14:51.267 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librgw2. 2023-09-23T07:14:51.293 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../019-librgw2_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:51.333 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librgw2 (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:51.870 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rgw. 2023-09-23T07:14:51.896 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:51.936 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rgw (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:52.281 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liboath0:amd64. 2023-09-23T07:14:52.307 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2023-09-23T07:14:52.347 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-09-23T07:14:52.625 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libradosstriper1. 2023-09-23T07:14:52.652 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:52.692 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libradosstriper1 (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:53.123 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-common. 2023-09-23T07:14:53.149 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../023-ceph-common_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:53.189 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-common (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:54.528 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-base. 2023-09-23T07:14:54.554 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../024-ceph-base_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:14:54.604 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-base (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:14:55.333 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-09-23T07:14:55.359 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-09-23T07:14:55.399 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-09-23T07:14:55.736 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cheroot. 2023-09-23T07:14:55.762 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-09-23T07:14:55.810 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-23T07:14:56.206 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-09-23T07:14:56.232 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-09-23T07:14:56.280 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-09-23T07:14:56.650 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.text. 2023-09-23T07:14:56.676 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2023-09-23T07:14:56.716 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-09-23T07:14:57.020 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-09-23T07:14:57.046 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-09-23T07:14:57.086 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-09-23T07:14:57.448 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempora. 2023-09-23T07:14:57.474 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2023-09-23T07:14:57.522 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-09-23T07:14:57.917 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-portend. 2023-09-23T07:14:57.943 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2023-09-23T07:14:57.992 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-09-23T07:14:58.295 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-09-23T07:14:58.321 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2023-09-23T07:14:58.361 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-09-23T07:14:58.957 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-23T07:14:58.983 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2023-09-23T07:14:59.031 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-09-23T07:14:59.444 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-natsort. 2023-09-23T07:14:59.470 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2023-09-23T07:14:59.510 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-09-23T07:14:59.796 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-logutils. 2023-09-23T07:14:59.812 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2023-09-23T07:14:59.855 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-09-23T07:15:00.141 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-23T07:15:00.167 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-09-23T07:15:00.208 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-09-23T07:15:00.511 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-mako. 2023-09-23T07:15:00.537 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-09-23T07:15:00.577 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-23T07:15:00.927 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-23T07:15:00.953 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-23T07:15:00.997 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-23T07:15:01.242 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-23T07:15:01.268 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-09-23T07:15:01.300 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-09-23T07:15:01.612 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webob. 2023-09-23T07:15:01.638 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-09-23T07:15:01.678 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-09-23T07:15:02.040 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-waitress. 2023-09-23T07:15:02.066 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-09-23T07:15:02.110 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-23T07:15:02.418 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempita. 2023-09-23T07:15:02.444 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-09-23T07:15:02.485 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-09-23T07:15:02.754 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-paste. 2023-09-23T07:15:02.780 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-09-23T07:15:02.812 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-09-23T07:15:03.107 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-23T07:15:03.134 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-09-23T07:15:03.174 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-09-23T07:15:03.435 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-23T07:15:03.450 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2023-09-23T07:15:03.485 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-09-23T07:15:03.789 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webtest. 2023-09-23T07:15:03.815 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2023-09-23T07:15:03.854 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-09-23T07:15:04.174 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pecan. 2023-09-23T07:15:04.201 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-09-23T07:15:04.274 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-09-23T07:15:04.630 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-certifi. 2023-09-23T07:15:04.656 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2023-09-23T07:15:04.696 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-09-23T07:15:05.007 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-idna. 2023-09-23T07:15:05.023 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2023-09-23T07:15:05.057 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-idna (3.3-1) ... 2023-09-23T07:15:05.344 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-urllib3. 2023-09-23T07:15:05.370 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-09-23T07:15:05.410 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-09-23T07:15:05.722 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests. 2023-09-23T07:15:05.748 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-09-23T07:15:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-23T07:15:06.892 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-23T07:15:06.919 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-09-23T07:15:06.958 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-23T07:15:07.245 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-23T07:15:07.272 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.0.0-6334-gee696c23-1jammy_all.deb ... 2023-09-23T07:15:07.311 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:07.717 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-23T07:15:07.743 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:07.783 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:08.103 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-openssl. 2023-09-23T07:15:08.129 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../055-python3-openssl_21.0.0-1_all.deb ... 2023-09-23T07:15:08.169 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-09-23T07:15:08.489 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr. 2023-09-23T07:15:08.516 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../056-ceph-mgr_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:08.556 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:08.942 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mon. 2023-09-23T07:15:08.969 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../057-ceph-mon_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:09.009 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mon (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:09.921 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-osd. 2023-09-23T07:15:09.947 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../058-ceph-osd_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:09.987 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-osd (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:11.824 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph. 2023-09-23T07:15:11.839 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../059-ceph_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:11.874 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:12.193 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-fuse. 2023-09-23T07:15:12.220 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../060-ceph-fuse_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:12.260 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-fuse (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:12.647 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mds. 2023-09-23T07:15:12.673 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../061-ceph-mds_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:12.713 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mds (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:13.058 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephadm. 2023-09-23T07:15:13.085 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../062-cephadm_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:13.125 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephadm (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:13.444 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-asyncssh. 2023-09-23T07:15:13.471 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../063-python3-asyncssh_2.5.0-1_all.deb ... 2023-09-23T07:15:13.511 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-09-23T07:15:13.831 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-babel-localedata. 2023-09-23T07:15:13.846 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../064-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-09-23T07:15:13.889 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-23T07:15:14.953 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-babel. 2023-09-23T07:15:14.980 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../065-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-09-23T07:15:15.019 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-09-23T07:15:15.331 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jinja2. 2023-09-23T07:15:15.358 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../066-python3-jinja2_3.0.3-1_all.deb ... 2023-09-23T07:15:15.397 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-09-23T07:15:15.701 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-23T07:15:15.717 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../067-ceph-mgr-cephadm_18.0.0-6334-gee696c23-1jammy_all.deb ... 2023-09-23T07:15:15.751 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:16.047 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-23T07:15:16.074 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../068-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-09-23T07:15:16.113 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-09-23T07:15:16.416 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-23T07:15:16.443 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../069-python3-repoze.lru_0.7-2_all.deb ... 2023-09-23T07:15:16.482 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-23T07:15:16.811 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-routes. 2023-09-23T07:15:16.838 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../070-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-09-23T07:15:16.877 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-09-23T07:15:17.198 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-23T07:15:17.225 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../071-ceph-mgr-dashboard_18.0.0-6334-gee696c23-1jammy_all.deb ... 2023-09-23T07:15:17.264 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:17.709 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-09-23T07:15:17.736 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../072-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-09-23T07:15:17.775 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-23T07:15:18.263 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-joblib. 2023-09-23T07:15:18.289 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../073-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-09-23T07:15:18.329 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-09-23T07:15:18.683 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-09-23T07:15:18.710 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../074-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-09-23T07:15:18.750 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-09-23T07:15:19.044 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn. 2023-09-23T07:15:19.072 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../075-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-09-23T07:15:19.102 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-23T07:15:19.804 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-23T07:15:19.831 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../076-ceph-mgr-diskprediction-local_18.0.0-6334-gee696c23-1jammy_all.deb ... 2023-09-23T07:15:19.895 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:20.823 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cachetools. 2023-09-23T07:15:20.850 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../077-python3-cachetools_5.0.0-1_all.deb ... 2023-09-23T07:15:20.906 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-09-23T07:15:21.193 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-23T07:15:21.220 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../078-python3-pyasn1_0.4.8-1_all.deb ... 2023-09-23T07:15:21.259 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-09-23T07:15:21.579 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-23T07:15:21.606 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../079-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-09-23T07:15:21.646 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-09-23T07:15:21.958 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rsa. 2023-09-23T07:15:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../080-python3-rsa_4.8-1_all.deb ... 2023-09-23T07:15:22.024 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rsa (4.8-1) ... 2023-09-23T07:15:22.344 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-google-auth. 2023-09-23T07:15:22.371 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../081-python3-google-auth_1.5.1-3_all.deb ... 2023-09-23T07:15:22.410 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-09-23T07:15:22.731 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-23T07:15:22.758 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../082-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-09-23T07:15:22.797 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-23T07:15:23.160 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-websocket. 2023-09-23T07:15:23.187 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../083-python3-websocket_1.2.3-1_all.deb ... 2023-09-23T07:15:23.218 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-09-23T07:15:23.531 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-23T07:15:23.558 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../084-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-09-23T07:15:23.597 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-23T07:15:24.245 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-23T07:15:24.272 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../085-ceph-mgr-k8sevents_18.0.0-6334-gee696c23-1jammy_all.deb ... 2023-09-23T07:15:24.311 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:25.014 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-23T07:15:25.042 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../086-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-09-23T07:15:25.080 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-23T07:15:25.392 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-23T07:15:25.419 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../087-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-09-23T07:15:25.450 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-23T07:15:25.703 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package jq. 2023-09-23T07:15:25.718 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../088-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-09-23T07:15:25.761 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-09-23T07:15:26.022 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package socat. 2023-09-23T07:15:26.038 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../089-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-09-23T07:15:26.081 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-09-23T07:15:26.384 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package xmlstarlet. 2023-09-23T07:15:26.400 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../090-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-09-23T07:15:26.442 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-09-23T07:15:26.805 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-test. 2023-09-23T07:15:26.832 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../091-ceph-test_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:26.880 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-test (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:29.192 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-volume. 2023-09-23T07:15:29.208 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../092-ceph-volume_18.0.0-6334-gee696c23-1jammy_all.deb ... 2023-09-23T07:15:29.250 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-volume (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:29.564 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-23T07:15:29.591 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../093-libcephfs-dev_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:29.630 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs-dev (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:30.134 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package nvme-cli. 2023-09-23T07:15:30.161 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../094-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-09-23T07:15:30.200 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-09-23T07:15:30.539 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-09-23T07:15:30.567 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../095-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-09-23T07:15:30.605 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-09-23T07:15:31.092 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-iniconfig. 2023-09-23T07:15:31.120 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../096-python3-iniconfig_1.1.1-2_all.deb ... 2023-09-23T07:15:31.159 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-09-23T07:15:31.437 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastescript. 2023-09-23T07:15:31.465 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2023-09-23T07:15:31.503 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-23T07:15:31.817 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pluggy. 2023-09-23T07:15:31.845 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-7.1_all.deb ... 2023-09-23T07:15:31.883 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-09-23T07:15:32.195 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-psutil. 2023-09-23T07:15:32.222 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../099-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-09-23T07:15:32.261 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-09-23T07:15:32.597 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-py. 2023-09-23T07:15:32.625 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../100-python3-py_1.10.0-1_all.deb ... 2023-09-23T07:15:32.663 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-py (1.10.0-1) ... 2023-09-23T07:15:32.966 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pygments. 2023-09-23T07:15:32.994 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../101-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-09-23T07:15:33.033 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-09-23T07:15:33.478 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-23T07:15:33.506 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../102-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-09-23T07:15:33.545 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-09-23T07:15:33.864 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-toml. 2023-09-23T07:15:33.892 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../103-python3-toml_0.10.2-1_all.deb ... 2023-09-23T07:15:33.930 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-09-23T07:15:34.233 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pytest. 2023-09-23T07:15:34.261 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../104-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-09-23T07:15:34.291 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-09-23T07:15:34.636 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplejson. 2023-09-23T07:15:34.664 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-09-23T07:15:34.703 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-09-23T07:15:34.980 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-23T07:15:34.997 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-09-23T07:15:35.038 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-09-23T07:15:35.759 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package radosgw. 2023-09-23T07:15:35.787 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../107-radosgw_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:35.817 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking radosgw (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:36.553 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package rbd-fuse. 2023-09-23T07:15:36.569 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../108-rbd-fuse_18.0.0-6334-gee696c23-1jammy_amd64.deb ... 2023-09-23T07:15:36.611 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking rbd-fuse (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:36.923 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-09-23T07:15:37.182 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-23T07:15:37.316 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-09-23T07:15:37.574 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-09-23T07:15:37.945 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-09-23T07:15:38.440 INFO:teuthology.orchestra.run.smithi107.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-09-23T07:15:38.543 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephadm (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:39.162 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user cephadm....done 2023-09-23T07:15:39.316 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-23T07:15:39.576 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-09-23T07:15:39.835 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-09-23T07:15:39.961 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-09-23T07:15:40.237 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-23T07:15:40.521 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-09-23T07:15:40.647 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-py (1.10.0-1) ... 2023-09-23T07:15:40.974 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-09-23T07:15:41.350 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-09-23T07:15:41.601 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-09-23T07:15:41.869 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-09-23T07:15:42.128 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-09-23T07:15:42.404 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-09-23T07:15:42.722 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-argparse (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:43.015 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-23T07:15:43.116 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-09-23T07:15:43.350 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-23T07:15:43.476 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-09-23T07:15:43.835 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-23T07:15:43.978 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-09-23T07:15:44.246 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-09-23T07:15:44.522 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-09-23T07:15:44.848 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-09-23T07:15:45.525 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-09-23T07:15:45.767 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-09-23T07:15:45.893 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-09-23T07:15:46.019 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-23T07:15:46.328 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-09-23T07:15:46.738 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-09-23T07:15:47.014 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-09-23T07:15:47.390 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-23T07:15:47.683 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-23T07:15:48.035 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-09-23T07:15:48.294 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-09-23T07:15:48.420 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-common (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:15:48.738 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-idna (3.3-1) ... 2023-09-23T07:15:49.064 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-23T07:15:50.336 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-23T07:15:50.486 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-toml (0.10.2-1) ... 2023-09-23T07:15:50.771 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-23T07:15:50.914 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-09-23T07:15:51.014 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-09-23T07:15:51.299 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-09-23T07:15:51.550 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-09-23T07:15:51.810 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-23T07:15:51.935 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-23T07:15:52.086 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-09-23T07:15:52.404 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-09-23T07:15:52.681 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-09-23T07:15:52.973 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-09-23T07:15:53.233 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-23T07:15:53.484 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-09-23T07:15:53.734 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-23T07:15:53.860 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-09-23T07:15:54.187 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-23T07:15:54.313 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-23T07:15:54.631 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-09-23T07:15:54.956 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-09-23T07:15:55.224 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-09-23T07:15:55.657 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-09-23T07:15:55.927 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-23T07:15:56.069 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-09-23T07:15:56.471 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-09-23T07:15:56.747 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-portend (3.0.0-1) ... 2023-09-23T07:15:57.015 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-23T07:15:57.149 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-09-23T07:15:57.466 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-09-23T07:15:57.776 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-23T07:15:58.052 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-09-23T07:15:58.178 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rsa (4.8-1) ... 2023-09-23T07:15:58.462 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-09-23T07:15:58.763 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-23T07:15:59.023 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-09-23T07:15:59.416 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-23T07:15:59.700 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-09-23T07:16:00.019 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-23T07:16:00.170 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librados2 (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:00.330 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librgw2 (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:00.480 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:00.631 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs2 (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:00.765 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libradosstriper1 (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:01.219 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-09-23T07:16:01.520 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librbd1 (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:01.654 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-modules-core (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:01.780 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-fuse (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:01.994 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-23T07:16:01.994 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-23T07:16:02.515 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs-dev (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:02.641 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rados (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:02.767 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-23T07:16:04.004 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rbd (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:04.180 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up rbd-fuse (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:04.331 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rgw (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:04.457 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cephfs (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:04.583 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-common (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:05.184 INFO:teuthology.orchestra.run.smithi107.stdout:Adding group ceph....done 2023-09-23T07:16:05.544 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user ceph....done 2023-09-23T07:16:05.712 INFO:teuthology.orchestra.run.smithi107.stdout:Setting system user ceph properties....done 2023-09-23T07:16:05.728 INFO:teuthology.orchestra.run.smithi107.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-23T07:16:05.862 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-23T07:16:06.204 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-23T07:16:06.792 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-test (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:06.918 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up radosgw (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:07.209 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-23T07:16:07.209 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-23T07:16:07.995 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-base (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:08.400 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-23T07:16:08.939 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mds (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:09.169 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-23T07:16:09.169 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-23T07:16:09.698 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:09.917 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-23T07:16:09.917 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-23T07:16:10.474 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-osd (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:10.775 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-23T07:16:10.775 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-23T07:16:11.428 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:11.788 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:11.947 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mon (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:12.146 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-23T07:16:12.146 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-23T07:16:12.698 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-cephadm (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:12.824 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:12.950 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-dashboard (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:13.109 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-volume (18.0.0-6334-gee696c23-1jammy) ... 2023-09-23T07:16:13.261 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-23T07:16:14.404 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-23T07:16:14.877 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-23T07:16:14.880 DEBUG:teuthology.parallel:result is None 2023-09-23T07:16:14.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e 2023-09-23T07:16:15.120 DEBUG:teuthology.orchestra.run.smithi107:> dpkg-query -W -f '${Version}' ceph 2023-09-23T07:16:15.139 INFO:teuthology.orchestra.run.smithi107.stdout:18.0.0-6334-gee696c23-1jammy 2023-09-23T07:16:15.139 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6334-gee696c23-1jammy 2023-09-23T07:16:15.140 INFO:teuthology.task.install:The correct ceph version 18.0.0-6334-gee696c23-1jammy is installed. 2023-09-23T07:16:15.140 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-23T07:16:15.140 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:15.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-23T07:16:15.193 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-23T07:16:15.193 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:15.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2023-09-23T07:16:15.252 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-23T07:16:15.307 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-23T07:16:15.308 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:15.308 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-23T07:16:15.360 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-23T07:16:15.415 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-23T07:16:15.415 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:15.416 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2023-09-23T07:16:15.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-23T07:16:15.520 INFO:teuthology.run_tasks:Running task ceph... 2023-09-23T07:16:15.586 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-23T07:16:15.586 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2023-09-23T07:16:15.599 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-23T07:16:15.600 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-23T07:16:15.652 INFO:tasks.ceph:Creating extra log directories... 2023-09-23T07:16:15.652 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-23T07:16:15.711 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-23T07:16:15.712 INFO:tasks.ceph:config {'conf': {'client': {'rbd default features': 1}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'debug rbd': 20}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-23T07:16:15.712 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi/7401660', 'branch': 'wip-62891', 'description': 'rbd:cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/layering msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_support_module_recovery}', 'email': 'rraja@redhat.com', 'first_in_suite': False, 'job_id': '7401660', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-62891'}, 'ceph': {'conf': {'client': {'rbd default features': 1}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'debug rbd': 20}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62891', 'sha1': 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e'}}, 'owner': 'scheduled_rraja@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 2241, 'sha1': 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e', 'sleep_before_teardown': 0, 'suite': 'rbd:cli', 'suite_branch': 'wip-62891', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e', 'targets': {'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxp9AoIIUd8hfqm7nPyzdllxCuvyrnO6WADnHDNin/IwxbIReaZKP9sHLQ65wGcgStKzGEWxd15xhcr9t2tiCE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'install': {'extra_system_packages': ['fio']}}, {'workunit': {'clients': {'client.0': ['rbd/rbd_support_module_recovery.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-23_06:37:41', 'tube': 'smithi', 'user': 'rraja', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-23T07:16:15.712 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-23T07:16:15.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2023-09-23T07:16:15.813 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:15.813 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2023-09-23T07:16:15.861 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-23T07:16:15.861 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2023-09-23T07:16:15.909 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-23T07:16:15.910 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T07:16:15.910 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 866 Links: 1 2023-09-23T07:16:15.910 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T07:16:15.910 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-09-23 07:11:00.948696817 +0000 2023-09-23T07:16:15.910 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-09-23 07:11:00.588700032 +0000 2023-09-23T07:16:15.910 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-09-23 07:11:00.588700032 +0000 2023-09-23T07:16:15.910 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2023-09-23T07:16:15.911 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-23T07:16:15.964 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-09-23T07:16:15.964 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-09-23T07:16:15.964 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000453554 s, 1.1 MB/s 2023-09-23T07:16:15.965 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-23T07:16:16.014 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2023-09-23T07:16:16.067 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-23T07:16:16.067 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T07:16:16.067 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 881 Links: 1 2023-09-23T07:16:16.067 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T07:16:16.067 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-09-23 07:11:01.544691494 +0000 2023-09-23T07:16:16.067 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-09-23 07:11:01.180694745 +0000 2023-09-23T07:16:16.067 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-09-23 07:11:01.180694745 +0000 2023-09-23T07:16:16.067 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2023-09-23T07:16:16.068 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-23T07:16:16.119 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-09-23T07:16:16.120 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-09-23T07:16:16.120 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.00038049 s, 1.3 MB/s 2023-09-23T07:16:16.121 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-23T07:16:16.170 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2023-09-23T07:16:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-23T07:16:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T07:16:16.217 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-09-23T07:16:16.217 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T07:16:16.217 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-09-23 07:11:02.156686027 +0000 2023-09-23T07:16:16.218 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-09-23 07:11:01.772689457 +0000 2023-09-23T07:16:16.218 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-09-23 07:11:01.772689457 +0000 2023-09-23T07:16:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2023-09-23T07:16:16.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-23T07:16:16.271 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-09-23T07:16:16.271 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-09-23T07:16:16.271 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.00042112 s, 1.2 MB/s 2023-09-23T07:16:16.272 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-23T07:16:16.322 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2023-09-23T07:16:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-23T07:16:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-23T07:16:16.369 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 914 Links: 1 2023-09-23T07:16:16.369 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-23T07:16:16.369 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-09-23 07:11:02.716681025 +0000 2023-09-23T07:16:16.369 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-09-23 07:11:02.380684026 +0000 2023-09-23T07:16:16.369 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-09-23 07:11:02.380684026 +0000 2023-09-23T07:16:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2023-09-23T07:16:16.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-23T07:16:16.423 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-09-23T07:16:16.423 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-09-23T07:16:16.424 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000375796 s, 1.4 MB/s 2023-09-23T07:16:16.424 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-23T07:16:16.474 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-23T07:16:16.474 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-09-23T07:16:16.474 INFO:tasks.ceph:Generating config... 2023-09-23T07:16:16.475 INFO:tasks.ceph:[client] rbd default features = 1 2023-09-23T07:16:16.475 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-09-23T07:16:16.476 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-09-23T07:16:16.476 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-09-23T07:16:16.476 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-23T07:16:16.476 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-23T07:16:16.476 INFO:tasks.ceph:[mgr] debug rbd = 20 2023-09-23T07:16:16.476 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-23T07:16:16.476 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-23T07:16:16.476 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-23T07:16:16.476 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-23T07:16:16.476 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2023-09-23T07:16:16.476 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-23T07:16:16.477 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-23T07:16:16.478 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-09-23T07:16:16.478 INFO:tasks.ceph:Setting up mon.a... 2023-09-23T07:16:16.478 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-23T07:16:16.548 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.keyring 2023-09-23T07:16:16.566 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-23T07:16:16.645 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-23T07:16:16.704 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.107')] 2023-09-23T07:16:16.705 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.107', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug rbd': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default features': 1}, 'mon.a': {}} 2023-09-23T07:16:16.705 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:16.706 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-23T07:16:16.753 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.107 --print /home/ubuntu/cephtest/ceph.monmap 2023-09-23T07:16:16.831 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-23T07:16:16.831 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: generated fsid 0225e296-dc9b-41de-b54f-a70821d0cf5c 2023-09-23T07:16:16.831 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = pacific 2023-09-23T07:16:16.831 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 0 2023-09-23T07:16:16.832 INFO:teuthology.orchestra.run.smithi107.stdout:fsid 0225e296-dc9b-41de-b54f-a70821d0cf5c 2023-09-23T07:16:16.832 INFO:teuthology.orchestra.run.smithi107.stdout:last_changed 2023-09-23T07:16:16.833043+0000 2023-09-23T07:16:16.832 INFO:teuthology.orchestra.run.smithi107.stdout:created 2023-09-23T07:16:16.833043+0000 2023-09-23T07:16:16.832 INFO:teuthology.orchestra.run.smithi107.stdout:min_mon_release 16 (pacific) 2023-09-23T07:16:16.832 INFO:teuthology.orchestra.run.smithi107.stdout:election_strategy: 1 2023-09-23T07:16:16.832 INFO:teuthology.orchestra.run.smithi107.stdout:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2023-09-23T07:16:16.832 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-09-23T07:16:16.833 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-23T07:16:16.881 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0225e296-dc9b-41de-b54f-a70821d0cf5c... 2023-09-23T07:16:16.882 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-23T07:16:16.955 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2023-09-23T07:16:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2023-09-23T07:16:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-23T07:16:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2023-09-23T07:16:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2023-09-23T07:16:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2023-09-23T07:16:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2023-09-23T07:16:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2023-09-23T07:16:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2023-09-23T07:16:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2023-09-23T07:16:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-23T07:16:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2023-09-23T07:16:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2023-09-23T07:16:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-23T07:16:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2023-09-23T07:16:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2023-09-23T07:16:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2023-09-23T07:16:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2023-09-23T07:16:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2023-09-23T07:16:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2023-09-23T07:16:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2023-09-23T07:16:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2023-09-23T07:16:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-23T07:16:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-23T07:16:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2023-09-23T07:16:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-23T07:16:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2023-09-23T07:16:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2023-09-23T07:16:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.960 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2023-09-23T07:16:16.960 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2023-09-23T07:16:16.960 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2023-09-23T07:16:16.960 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = 172.21.15.107 2023-09-23T07:16:16.960 INFO:teuthology.orchestra.run.smithi107.stdout: mon client directed command retry = 5 2023-09-23T07:16:16.960 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on pool no app = False 2023-09-23T07:16:16.960 INFO:teuthology.orchestra.run.smithi107.stdout: ms inject socket failures = 5000 2023-09-23T07:16:16.960 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 0225e296-dc9b-41de-b54f-a70821d0cf5c 2023-09-23T07:16:16.960 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.961 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2023-09-23T07:16:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2023-09-23T07:16:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2023-09-23T07:16:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2023-09-23T07:16:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2023-09-23T07:16:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2023-09-23T07:16:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2023-09-23T07:16:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2023-09-23T07:16:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2023-09-23T07:16:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2023-09-23T07:16:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2023-09-23T07:16:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2023-09-23T07:16:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2023-09-23T07:16:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2023-09-23T07:16:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2023-09-23T07:16:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2023-09-23T07:16:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2023-09-23T07:16:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2023-09-23T07:16:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2023-09-23T07:16:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2023-09-23T07:16:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore compression algorithm = zlib 2023-09-23T07:16:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore compression mode = aggressive 2023-09-23T07:16:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2023-09-23T07:16:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2023-09-23T07:16:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2023-09-23T07:16:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2023-09-23T07:16:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2023-09-23T07:16:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2023-09-23T07:16:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2023-09-23T07:16:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2023-09-23T07:16:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2023-09-23T07:16:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2023-09-23T07:16:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2023-09-23T07:16:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: osd shutdown pgref assert = True 2023-09-23T07:16:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.966 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2023-09-23T07:16:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2023-09-23T07:16:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2023-09-23T07:16:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2023-09-23T07:16:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2023-09-23T07:16:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2023-09-23T07:16:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2023-09-23T07:16:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2023-09-23T07:16:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: debug rbd = 20 2023-09-23T07:16:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.967 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2023-09-23T07:16:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2023-09-23T07:16:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2023-09-23T07:16:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2023-09-23T07:16:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2023-09-23T07:16:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2023-09-23T07:16:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2023-09-23T07:16:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2023-09-23T07:16:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2023-09-23T07:16:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2023-09-23T07:16:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2023-09-23T07:16:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:16.969 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2023-09-23T07:16:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2023-09-23T07:16:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2023-09-23T07:16:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2023-09-23T07:16:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-23T07:16:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-23T07:16:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: rbd default features = 1 2023-09-23T07:16:16.970 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2023-09-23T07:16:16.971 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-23T07:16:16.971 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-23T07:16:17.063 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-23T07:16:17.064 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:17.064 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-23T07:16:17.069 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:17.069 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-23T07:16:17.118 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2023-09-23T07:16:17.118 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:17.118 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-23T07:16:17.118 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-23T07:16:17.181 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:17.181 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-23T07:16:17.233 INFO:tasks.ceph:Setting up mon nodes... 2023-09-23T07:16:17.233 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-23T07:16:17.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-23T07:16:17.317 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-23T07:16:17.321 INFO:tasks.ceph:Setting up mds nodes... 2023-09-23T07:16:17.321 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-23T07:16:17.321 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-23T07:16:17.396 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-23T07:16:17.408 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-23T07:16:17.408 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-09-23T07:16:17.408 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-23T07:16:17.464 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-23T07:16:17.464 INFO:tasks.ceph:role: osd.0 2023-09-23T07:16:17.464 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2023-09-23T07:16:17.464 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-23T07:16:17.529 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-23T07:16:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-23T07:16:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-23T07:16:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-23T07:16:17.529 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-23T07:16:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2023-09-23T07:16:17.529 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-23T07:16:17.529 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-23T07:16:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-23T07:16:17.530 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-23T07:16:17.986 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2023-09-23T07:16:17.989 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2023-09-23T07:16:17.989 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-23T07:16:18.080 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-23T07:16:18.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T07:16:18.091 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2023-09-23T07:16:18.091 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-23T07:16:18.148 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-23T07:16:18.148 INFO:tasks.ceph:role: osd.1 2023-09-23T07:16:18.148 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2023-09-23T07:16:18.148 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-23T07:16:18.208 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-23T07:16:18.208 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-23T07:16:18.208 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-23T07:16:18.208 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-23T07:16:18.208 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-23T07:16:18.208 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2023-09-23T07:16:18.208 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-23T07:16:18.208 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-23T07:16:18.208 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-23T07:16:18.208 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-23T07:16:18.677 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2023-09-23T07:16:18.680 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2023-09-23T07:16:18.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-23T07:16:18.830 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-23T07:16:18.843 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2023-09-23T07:16:18.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T07:16:18.844 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-23T07:16:18.896 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-23T07:16:18.896 INFO:tasks.ceph:role: osd.2 2023-09-23T07:16:18.896 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2023-09-23T07:16:18.896 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-23T07:16:18.960 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-23T07:16:18.960 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-23T07:16:18.960 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-23T07:16:18.960 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-23T07:16:18.960 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-23T07:16:18.960 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2023-09-23T07:16:18.960 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-23T07:16:18.960 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-23T07:16:18.961 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-23T07:16:18.961 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-23T07:16:19.433 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2023-09-23T07:16:19.435 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2023-09-23T07:16:19.435 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-23T07:16:19.579 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-23T07:16:19.590 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2023-09-23T07:16:19.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T07:16:19.591 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-23T07:16:19.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:19.731+0000 7f3b75a79640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-23T07:16:19.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:19.731+0000 7f3b75a79640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-23T07:16:19.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:19.731+0000 7f3b75a79640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-23T07:16:19.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:19.731+0000 7f3b75a79640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-23T07:16:19.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:19.731+0000 7f3b75a79640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-23T07:16:19.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:19.731+0000 7f3b75a79640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-23T07:16:22.768 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-23T07:16:22.781 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-23T07:16:22.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:22.859+0000 7f5cebd30640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-23T07:16:22.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:22.859+0000 7f5cebd30640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-23T07:16:22.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:22.859+0000 7f5cebd30640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-23T07:16:22.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:22.859+0000 7f5cebd30640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-23T07:16:22.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:22.859+0000 7f5cebd30640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-23T07:16:22.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:22.859+0000 7f5cebd30640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-23T07:16:25.906 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-23T07:16:25.962 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-23T07:16:26.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:26.039+0000 7efceddbd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-23T07:16:26.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:26.043+0000 7efceddbd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-23T07:16:26.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:26.043+0000 7efceddbd640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-23T07:16:26.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:26.043+0000 7efceddbd640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-23T07:16:26.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:26.043+0000 7efceddbd640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-23T07:16:26.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T07:16:26.043+0000 7efceddbd640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-23T07:16:29.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-23T07:16:29.109 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-23T07:16:29.109 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:29.109 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-23T07:16:29.163 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:29.163 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-23T07:16:29.220 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:29.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-23T07:16:29.276 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:29.276 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-23T07:16:29.332 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:29.333 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-23T07:16:29.385 INFO:tasks.ceph:Adding keys to all mons... 2023-09-23T07:16:29.385 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-23T07:16:29.439 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2023-09-23T07:16:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDBkA5lkN0LExAAxo28TEoT8IJYXQg1Y0SLyQ== 2023-09-23T07:16:29.439 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2023-09-23T07:16:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDDkA5lIb/lKxAAKbYFTE9fteTA8GiL56vcAQ== 2023-09-23T07:16:29.439 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2023-09-23T07:16:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDGkA5l4tSGMxAA7x/wlCFrvm+LcOeymUzUYw== 2023-09-23T07:16:29.439 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2023-09-23T07:16:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDKkA5lAde3AhAApeOZKnVARohbc54rxLQbgA== 2023-09-23T07:16:29.439 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2023-09-23T07:16:29.440 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDBkA5lsx69FxAA/37MDXLVq+RMXoSVRQvcIw== 2023-09-23T07:16:29.440 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-23T07:16:29.528 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-23T07:16:29.609 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-23T07:16:29.697 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-23T07:16:29.779 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-23T07:16:29.863 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-23T07:16:29.864 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-23T07:16:29.920 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-23T07:16:30.017 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-23T07:16:30.027 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-23T07:16:30.072 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-23T07:16:30.072 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-23T07:16:30.072 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-23T07:16:30.113 INFO:tasks.ceph.mon.a:Started 2023-09-23T07:16:30.114 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-23T07:16:30.114 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-23T07:16:30.114 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-23T07:16:30.116 INFO:tasks.ceph.mgr.x:Started 2023-09-23T07:16:30.116 INFO:tasks.ceph:Setting crush tunables to default 2023-09-23T07:16:30.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd crush tunables default 2023-09-23T07:16:30.368 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2023-09-23T07:16:30.387 INFO:tasks.ceph:check_enable_crimson: False 2023-09-23T07:16:30.387 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-23T07:16:30.387 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:30.387 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-23T07:16:30.398 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:30.398 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-23T07:16:30.451 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:30.451 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-23T07:16:30.493 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:30.491+0000 7f9a7fa08180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-23T07:16:30.505 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 281c78ca-bc94-413f-90c5-069cbe97fa37 0 2023-09-23T07:16:30.741 INFO:teuthology.orchestra.run.smithi107.stdout:0 2023-09-23T07:16:30.757 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 4cdbf0c8-ab19-4c5f-acd3-a642e52ea2b2 1 2023-09-23T07:16:30.948 INFO:teuthology.orchestra.run.smithi107.stdout:1 2023-09-23T07:16:30.964 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new c75f2c99-285f-45a4-9f03-df7b3547bbaa 2 2023-09-23T07:16:31.017 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:31.015+0000 7f9a7fa08180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-23T07:16:31.154 INFO:teuthology.orchestra.run.smithi107.stdout:2 2023-09-23T07:16:31.171 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-23T07:16:31.171 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-23T07:16:31.174 INFO:tasks.ceph.osd.0:Started 2023-09-23T07:16:31.174 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-23T07:16:31.175 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-23T07:16:31.177 INFO:tasks.ceph.osd.1:Started 2023-09-23T07:16:31.178 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-23T07:16:31.178 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-23T07:16:31.180 INFO:tasks.ceph.osd.2:Started 2023-09-23T07:16:31.181 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T07:16:31.204 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:31.199+0000 7f9a7fa08180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-23T07:16:31.370 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:31.370 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":5,"fsid":"0225e296-dc9b-41de-b54f-a70821d0cf5c","created":"2023-09-23T07:16:30.251208+0000","modified":"2023-09-23T07:16:31.153990+0000","last_up_change":"0.000000","last_in_change":"2023-09-23T07:16:31.153990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"281c78ca-bc94-413f-90c5-069cbe97fa37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4cdbf0c8-ab19-4c5f-acd3-a642e52ea2b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c75f2c99-285f-45a4-9f03-df7b3547bbaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T07:16:31.387 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-23T07:16:31.387 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-23T07:16:31.689 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-23T07:16:31.790 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:16:31.787+0000 7fbe4caa9640 -1 Falling back to public interface 2023-09-23T07:16:31.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:16:31.795+0000 7ff9f8661640 -1 Falling back to public interface 2023-09-23T07:16:31.801 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:16:31.799+0000 7f3eed885640 -1 Falling back to public interface 2023-09-23T07:16:31.803 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:31.799+0000 7f9a7fa08180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-23T07:16:31.858 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:31.855+0000 7f9a7fa08180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-23T07:16:31.867 INFO:teuthology.misc.health.smithi107.stdout: 2023-09-23T07:16:31.867 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":5,"fsid":"0225e296-dc9b-41de-b54f-a70821d0cf5c","created":"2023-09-23T07:16:30.251208+0000","modified":"2023-09-23T07:16:31.153990+0000","last_up_change":"0.000000","last_in_change":"2023-09-23T07:16:31.153990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"281c78ca-bc94-413f-90c5-069cbe97fa37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4cdbf0c8-ab19-4c5f-acd3-a642e52ea2b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c75f2c99-285f-45a4-9f03-df7b3547bbaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T07:16:31.882 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-09-23T07:16:31.913 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:31.911+0000 7f9a7fa08180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-23T07:16:31.989 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:31.987+0000 7f9a7fa08180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-23T07:16:32.040 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:32.035+0000 7f9a7fa08180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-23T07:16:32.116 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:32.111+0000 7f9a7fa08180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-23T07:16:32.167 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:32.163+0000 7f9a7fa08180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-23T07:16:32.306 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:32.303+0000 7f9a7fa08180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-23T07:16:32.364 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:32.359+0000 7f9a7fa08180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-23T07:16:33.099 INFO:tasks.ceph.mgr.x.smithi107.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-09-23T07:16:33.099 INFO:tasks.ceph.mgr.x.smithi107.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-09-23T07:16:33.100 INFO:tasks.ceph.mgr.x.smithi107.stderr: from numpy import show_config as show_numpy_config 2023-09-23T07:16:33.178 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:33.175+0000 7f9a7fa08180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-23T07:16:33.349 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:33.347+0000 7f9a7fa08180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-23T07:16:33.516 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:33.511+0000 7f9a7fa08180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-23T07:16:33.585 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:33.583+0000 7f9a7fa08180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-23T07:16:33.720 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:33.715+0000 7f9a7fa08180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-23T07:16:34.338 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:34.335+0000 7f9a7fa08180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-23T07:16:34.412 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:34.411+0000 7f9a7fa08180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-23T07:16:34.583 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:34.579+0000 7f9a7fa08180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-23T07:16:34.660 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:34.659+0000 7f9a7fa08180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-23T07:16:34.954 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:34.951+0000 7f9a7fa08180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-23T07:16:35.031 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:35.027+0000 7f9a7fa08180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-23T07:16:35.697 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:16:35.695+0000 7fbe4caa9640 -1 osd.0 0 log_to_monitors true 2023-09-23T07:16:35.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:16:35.707+0000 7ff9f8661640 -1 osd.1 0 log_to_monitors true 2023-09-23T07:16:35.784 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:16:35.779+0000 7f3eed885640 -1 osd.2 0 log_to_monitors true 2023-09-23T07:16:36.267 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:16:36.263+0000 7f9a2737a640 -1 mgr.server handle_report got status from non-daemon mon.a 2023-09-23T07:16:38.185 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-23T07:16:38.474 INFO:teuthology.misc.health.smithi107.stdout: 2023-09-23T07:16:38.474 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":7,"fsid":"0225e296-dc9b-41de-b54f-a70821d0cf5c","created":"2023-09-23T07:16:30.251208+0000","modified":"2023-09-23T07:16:37.199193+0000","last_up_change":"0.000000","last_in_change":"2023-09-23T07:16:31.153990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"281c78ca-bc94-413f-90c5-069cbe97fa37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4cdbf0c8-ab19-4c5f-acd3-a642e52ea2b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c75f2c99-285f-45a4-9f03-df7b3547bbaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T07:16:38.492 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-09-23T07:16:40.247 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:16:40.243+0000 7fbe48a51640 -1 osd.0 0 waiting for initial osdmap 2023-09-23T07:16:40.268 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:16:40.267+0000 7fbe40886640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T07:16:40.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:16:40.335+0000 7ff9f4609640 -1 osd.1 0 waiting for initial osdmap 2023-09-23T07:16:40.358 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:16:40.355+0000 7f3ee982d640 -1 osd.2 0 waiting for initial osdmap 2023-09-23T07:16:40.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:16:40.363+0000 7ff9ec43e640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T07:16:40.384 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:16:40.383+0000 7f3ee1662640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-23T07:16:44.795 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-23T07:16:45.114 INFO:teuthology.misc.health.smithi107.stdout: 2023-09-23T07:16:45.114 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":11,"fsid":"0225e296-dc9b-41de-b54f-a70821d0cf5c","created":"2023-09-23T07:16:30.251208+0000","modified":"2023-09-23T07:16:44.263726+0000","last_up_change":"2023-09-23T07:16:41.250301+0000","last_in_change":"2023-09-23T07:16:31.153990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T07:16:43.129545+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"281c78ca-bc94-413f-90c5-069cbe97fa37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6801","nonce":2734954741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6803","nonce":2734954741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6807","nonce":2734954741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6805","nonce":2734954741}]},"public_addr":"172.21.15.107:6801/2734954741","cluster_addr":"172.21.15.107:6803/2734954741","heartbeat_back_addr":"172.21.15.107:6807/2734954741","heartbeat_front_addr":"172.21.15.107:6805/2734954741","state":["exists","up"]},{"osd":1,"uuid":"4cdbf0c8-ab19-4c5f-acd3-a642e52ea2b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6809","nonce":1741437062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6811","nonce":1741437062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6815","nonce":1741437062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6813","nonce":1741437062}]},"public_addr":"172.21.15.107:6809/1741437062","cluster_addr":"172.21.15.107:6811/1741437062","heartbeat_back_addr":"172.21.15.107:6815/1741437062","heartbeat_front_addr":"172.21.15.107:6813/1741437062","state":["exists","up"]},{"osd":2,"uuid":"c75f2c99-285f-45a4-9f03-df7b3547bbaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6817","nonce":3526584739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6819","nonce":3526584739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6823","nonce":3526584739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6821","nonce":3526584739}]},"public_addr":"172.21.15.107:6817/3526584739","cluster_addr":"172.21.15.107:6819/3526584739","heartbeat_back_addr":"172.21.15.107:6823/3526584739","heartbeat_front_addr":"172.21.15.107:6821/3526584739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.675027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.761285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.823646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T07:16:45.133 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-09-23T07:16:45.133 INFO:tasks.ceph:Creating RBD pool 2023-09-23T07:16:45.134 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-23T07:16:46.281 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'rbd' created 2023-09-23T07:16:46.309 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-23T07:16:47.287 INFO:teuthology.orchestra.run.smithi107.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-23T07:16:47.318 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-23T07:16:47.318 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-23T07:16:47.318 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-23T07:16:47.318 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-23T07:16:47.319 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-23T07:16:47.642 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:47.657 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2532525938},{"type":"v1","addr":"172.21.15.107:6825","nonce":2532525938}]},"active_addr":"172.21.15.107:6825/2532525938","active_change":"2023-09-23T07:16:35.051484+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":298040532}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3230490668}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3378109360}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":2439602585}]}]} 2023-09-23T07:16:47.660 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-23T07:16:47.660 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-23T07:16:47.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T07:16:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:47.921 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":14,"fsid":"0225e296-dc9b-41de-b54f-a70821d0cf5c","created":"2023-09-23T07:16:30.251208+0000","modified":"2023-09-23T07:16:47.282913+0000","last_up_change":"2023-09-23T07:16:41.250301+0000","last_in_change":"2023-09-23T07:16:31.153990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T07:16:43.129545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-23T07:16:45.469478+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"281c78ca-bc94-413f-90c5-069cbe97fa37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6801","nonce":2734954741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6803","nonce":2734954741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6807","nonce":2734954741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6805","nonce":2734954741}]},"public_addr":"172.21.15.107:6801/2734954741","cluster_addr":"172.21.15.107:6803/2734954741","heartbeat_back_addr":"172.21.15.107:6807/2734954741","heartbeat_front_addr":"172.21.15.107:6805/2734954741","state":["exists","up"]},{"osd":1,"uuid":"4cdbf0c8-ab19-4c5f-acd3-a642e52ea2b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6809","nonce":1741437062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6811","nonce":1741437062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6815","nonce":1741437062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6813","nonce":1741437062}]},"public_addr":"172.21.15.107:6809/1741437062","cluster_addr":"172.21.15.107:6811/1741437062","heartbeat_back_addr":"172.21.15.107:6815/1741437062","heartbeat_front_addr":"172.21.15.107:6813/1741437062","state":["exists","up"]},{"osd":2,"uuid":"c75f2c99-285f-45a4-9f03-df7b3547bbaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6817","nonce":3526584739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6819","nonce":3526584739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6823","nonce":3526584739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6821","nonce":3526584739}]},"public_addr":"172.21.15.107:6817/3526584739","cluster_addr":"172.21.15.107:6819/3526584739","heartbeat_back_addr":"172.21.15.107:6823/3526584739","heartbeat_front_addr":"172.21.15.107:6821/3526584739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.675027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.761285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.823646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T07:16:47.938 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-23T07:16:47.938 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T07:16:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:48.207 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":14,"fsid":"0225e296-dc9b-41de-b54f-a70821d0cf5c","created":"2023-09-23T07:16:30.251208+0000","modified":"2023-09-23T07:16:47.282913+0000","last_up_change":"2023-09-23T07:16:41.250301+0000","last_in_change":"2023-09-23T07:16:31.153990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T07:16:43.129545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-23T07:16:45.469478+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"281c78ca-bc94-413f-90c5-069cbe97fa37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6801","nonce":2734954741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6803","nonce":2734954741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6807","nonce":2734954741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6805","nonce":2734954741}]},"public_addr":"172.21.15.107:6801/2734954741","cluster_addr":"172.21.15.107:6803/2734954741","heartbeat_back_addr":"172.21.15.107:6807/2734954741","heartbeat_front_addr":"172.21.15.107:6805/2734954741","state":["exists","up"]},{"osd":1,"uuid":"4cdbf0c8-ab19-4c5f-acd3-a642e52ea2b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6809","nonce":1741437062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6811","nonce":1741437062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6815","nonce":1741437062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6813","nonce":1741437062}]},"public_addr":"172.21.15.107:6809/1741437062","cluster_addr":"172.21.15.107:6811/1741437062","heartbeat_back_addr":"172.21.15.107:6815/1741437062","heartbeat_front_addr":"172.21.15.107:6813/1741437062","state":["exists","up"]},{"osd":2,"uuid":"c75f2c99-285f-45a4-9f03-df7b3547bbaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6817","nonce":3526584739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6819","nonce":3526584739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6823","nonce":3526584739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6821","nonce":3526584739}]},"public_addr":"172.21.15.107:6817/3526584739","cluster_addr":"172.21.15.107:6819/3526584739","heartbeat_back_addr":"172.21.15.107:6823/3526584739","heartbeat_front_addr":"172.21.15.107:6821/3526584739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.675027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.761285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.823646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T07:16:48.223 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-23T07:16:48.224 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-23T07:16:48.224 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-23T07:16:48.375 INFO:teuthology.orchestra.run.smithi107.stdout:34359738373 2023-09-23T07:16:48.375 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-23T07:16:48.382 INFO:teuthology.orchestra.run.smithi107.stdout:34359738374 2023-09-23T07:16:48.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-23T07:16:48.384 INFO:teuthology.orchestra.run.smithi107.stdout:34359738374 2023-09-23T07:16:48.384 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-23T07:16:48.673 INFO:teuthology.orchestra.run.smithi107.stdout:34359738371 2023-09-23T07:16:48.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738371 for osd.0 2023-09-23T07:16:48.701 INFO:teuthology.orchestra.run.smithi107.stdout:34359738372 2023-09-23T07:16:48.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738372 for osd.2 2023-09-23T07:16:48.722 INFO:teuthology.orchestra.run.smithi107.stdout:34359738372 2023-09-23T07:16:48.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738372 for osd.1 2023-09-23T07:16:49.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-23T07:16:49.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-23T07:16:49.740 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-23T07:16:50.049 INFO:teuthology.orchestra.run.smithi107.stdout:34359738373 2023-09-23T07:16:50.063 INFO:teuthology.orchestra.run.smithi107.stdout:34359738374 2023-09-23T07:16:50.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.0 2023-09-23T07:16:50.066 DEBUG:teuthology.parallel:result is None 2023-09-23T07:16:50.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2023-09-23T07:16:50.080 DEBUG:teuthology.parallel:result is None 2023-09-23T07:16:50.086 INFO:teuthology.orchestra.run.smithi107.stdout:34359738374 2023-09-23T07:16:50.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2023-09-23T07:16:50.103 DEBUG:teuthology.parallel:result is None 2023-09-23T07:16:50.103 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-23T07:16:50.103 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T07:16:50.426 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:50.426 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T07:16:50.444 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-09-23T07:16:49.060075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81552,"kb_used_data":472,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033968,"statfs":{"total":289910292480,"available":289826783232,"internally_reserved":0,"allocated":483328,"data_stored":1281896,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.769758"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-23T07:16:48.294643+0000","last_change":"2023-09-23T07:16:47.301114+0000","last_active":"2023-09-23T07:16:48.294643+0000","last_peered":"2023-09-23T07:16:48.294643+0000","last_clean":"2023-09-23T07:16:48.294643+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T07:16:48.294643+0000","last_undegraded":"2023-09-23T07:16:48.294643+0000","last_fullsized":"2023-09-23T07:16:48.294643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:12:59.524885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-23T07:16:48.294557+0000","last_change":"2023-09-23T07:16:47.301753+0000","last_active":"2023-09-23T07:16:48.294557+0000","last_peered":"2023-09-23T07:16:48.294557+0000","last_clean":"2023-09-23T07:16:48.294557+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T07:16:48.294557+0000","last_undegraded":"2023-09-23T07:16:48.294557+0000","last_fullsized":"2023-09-23T07:16:48.294557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:15:26.392747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-23T07:16:48.294506+0000","last_change":"2023-09-23T07:16:47.303786+0000","last_active":"2023-09-23T07:16:48.294506+0000","last_peered":"2023-09-23T07:16:48.294506+0000","last_clean":"2023-09-23T07:16:48.294506+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T07:16:48.294506+0000","last_undegraded":"2023-09-23T07:16:48.294506+0000","last_fullsized":"2023-09-23T07:16:48.294506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:15:17.197422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-23T07:16:48.294415+0000","last_change":"2023-09-23T07:16:47.300940+0000","last_active":"2023-09-23T07:16:48.294415+0000","last_peered":"2023-09-23T07:16:48.294415+0000","last_clean":"2023-09-23T07:16:48.294415+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T07:16:48.294415+0000","last_undegraded":"2023-09-23T07:16:48.294415+0000","last_fullsized":"2023-09-23T07:16:48.294415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:29:56.969020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-23T07:16:47.302564+0000","last_change":"2023-09-23T07:16:47.302564+0000","last_active":"2023-09-23T07:16:47.302564+0000","last_peered":"2023-09-23T07:16:47.302564+0000","last_clean":"2023-09-23T07:16:47.302564+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T07:16:47.302564+0000","last_undegraded":"2023-09-23T07:16:47.302564+0000","last_fullsized":"2023-09-23T07:16:47.302564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:34:56.700023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-23T07:16:47.303601+0000","last_change":"2023-09-23T07:16:47.303601+0000","last_active":"2023-09-23T07:16:47.303601+0000","last_peered":"2023-09-23T07:16:47.303601+0000","last_clean":"2023-09-23T07:16:47.303601+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T07:16:47.303601+0000","last_undegraded":"2023-09-23T07:16:47.303601+0000","last_fullsized":"2023-09-23T07:16:47.303601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:27:05.491344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-23T07:16:47.301729+0000","last_change":"2023-09-23T07:16:47.301729+0000","last_active":"2023-09-23T07:16:47.301729+0000","last_peered":"2023-09-23T07:16:47.301729+0000","last_clean":"2023-09-23T07:16:47.301729+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T07:16:47.301729+0000","last_undegraded":"2023-09-23T07:16:47.301729+0000","last_fullsized":"2023-09-23T07:16:47.301729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:27:28.165778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-23T07:16:48.294312+0000","last_change":"2023-09-23T07:16:47.300714+0000","last_active":"2023-09-23T07:16:48.294312+0000","last_peered":"2023-09-23T07:16:48.294312+0000","last_clean":"2023-09-23T07:16:48.294312+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T07:16:48.294312+0000","last_undegraded":"2023-09-23T07:16:48.294312+0000","last_fullsized":"2023-09-23T07:16:48.294312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:37:01.716500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-23T07:16:47.297757+0000","last_change":"2023-09-23T07:16:44.817065+0000","last_active":"2023-09-23T07:16:47.297757+0000","last_peered":"2023-09-23T07:16:47.297757+0000","last_clean":"2023-09-23T07:16:47.297757+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T07:16:47.297757+0000","last_undegraded":"2023-09-23T07:16:47.297757+0000","last_fullsized":"2023-09-23T07:16:47.297757+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_clean_scrub_stamp":"2023-09-23T07:16:43.255638+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:01:32.785546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":122880,"data_stored":33720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":624088,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":624088,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-23T07:16:50.445 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T07:16:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:50.713 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T07:16:50.730 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-09-23T07:16:49.060075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81552,"kb_used_data":472,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033968,"statfs":{"total":289910292480,"available":289826783232,"internally_reserved":0,"allocated":483328,"data_stored":1281896,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.769758"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-23T07:16:48.294643+0000","last_change":"2023-09-23T07:16:47.301114+0000","last_active":"2023-09-23T07:16:48.294643+0000","last_peered":"2023-09-23T07:16:48.294643+0000","last_clean":"2023-09-23T07:16:48.294643+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T07:16:48.294643+0000","last_undegraded":"2023-09-23T07:16:48.294643+0000","last_fullsized":"2023-09-23T07:16:48.294643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:12:59.524885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-23T07:16:48.294557+0000","last_change":"2023-09-23T07:16:47.301753+0000","last_active":"2023-09-23T07:16:48.294557+0000","last_peered":"2023-09-23T07:16:48.294557+0000","last_clean":"2023-09-23T07:16:48.294557+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T07:16:48.294557+0000","last_undegraded":"2023-09-23T07:16:48.294557+0000","last_fullsized":"2023-09-23T07:16:48.294557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:15:26.392747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-23T07:16:48.294506+0000","last_change":"2023-09-23T07:16:47.303786+0000","last_active":"2023-09-23T07:16:48.294506+0000","last_peered":"2023-09-23T07:16:48.294506+0000","last_clean":"2023-09-23T07:16:48.294506+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T07:16:48.294506+0000","last_undegraded":"2023-09-23T07:16:48.294506+0000","last_fullsized":"2023-09-23T07:16:48.294506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T09:15:17.197422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-23T07:16:48.294415+0000","last_change":"2023-09-23T07:16:47.300940+0000","last_active":"2023-09-23T07:16:48.294415+0000","last_peered":"2023-09-23T07:16:48.294415+0000","last_clean":"2023-09-23T07:16:48.294415+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T07:16:48.294415+0000","last_undegraded":"2023-09-23T07:16:48.294415+0000","last_fullsized":"2023-09-23T07:16:48.294415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:29:56.969020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-23T07:16:47.302564+0000","last_change":"2023-09-23T07:16:47.302564+0000","last_active":"2023-09-23T07:16:47.302564+0000","last_peered":"2023-09-23T07:16:47.302564+0000","last_clean":"2023-09-23T07:16:47.302564+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T07:16:47.302564+0000","last_undegraded":"2023-09-23T07:16:47.302564+0000","last_fullsized":"2023-09-23T07:16:47.302564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:34:56.700023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-23T07:16:47.303601+0000","last_change":"2023-09-23T07:16:47.303601+0000","last_active":"2023-09-23T07:16:47.303601+0000","last_peered":"2023-09-23T07:16:47.303601+0000","last_clean":"2023-09-23T07:16:47.303601+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T07:16:47.303601+0000","last_undegraded":"2023-09-23T07:16:47.303601+0000","last_fullsized":"2023-09-23T07:16:47.303601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T11:27:05.491344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-23T07:16:47.301729+0000","last_change":"2023-09-23T07:16:47.301729+0000","last_active":"2023-09-23T07:16:47.301729+0000","last_peered":"2023-09-23T07:16:47.301729+0000","last_clean":"2023-09-23T07:16:47.301729+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T07:16:47.301729+0000","last_undegraded":"2023-09-23T07:16:47.301729+0000","last_fullsized":"2023-09-23T07:16:47.301729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:27:28.165778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-23T07:16:48.294312+0000","last_change":"2023-09-23T07:16:47.300714+0000","last_active":"2023-09-23T07:16:48.294312+0000","last_peered":"2023-09-23T07:16:48.294312+0000","last_clean":"2023-09-23T07:16:48.294312+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T07:16:48.294312+0000","last_undegraded":"2023-09-23T07:16:48.294312+0000","last_fullsized":"2023-09-23T07:16:48.294312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T14:37:01.716500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-23T07:16:47.297757+0000","last_change":"2023-09-23T07:16:44.817065+0000","last_active":"2023-09-23T07:16:47.297757+0000","last_peered":"2023-09-23T07:16:47.297757+0000","last_clean":"2023-09-23T07:16:47.297757+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T07:16:47.297757+0000","last_undegraded":"2023-09-23T07:16:47.297757+0000","last_fullsized":"2023-09-23T07:16:47.297757+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_clean_scrub_stamp":"2023-09-23T07:16:43.255638+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:01:32.785546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":122880,"data_stored":33720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":624088,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":624088,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-23T07:16:50.731 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-23T07:16:50.731 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-23T07:16:50.731 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-23T07:16:50.731 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-23T07:16:51.050 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T07:16:51.050 INFO:teuthology.orchestra.run.smithi107.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-23T07:16:51.068 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-23T07:16:51.068 INFO:teuthology.run_tasks:Running task install... 2023-09-23T07:16:51.076 DEBUG:teuthology.task.install:project ceph 2023-09-23T07:16:51.076 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e'}} 2023-09-23T07:16:51.076 DEBUG:teuthology.task.install:config {'extra_system_packages': ['fio'], 'flavor': 'default', 'sha1': 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e'} 2023-09-23T07:16:51.076 INFO:teuthology.task.install:Using flavor: default 2023-09-23T07:16:51.082 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-23T07:16:51.082 INFO:teuthology.task.install:extra packages: [] 2023-09-23T07:16:51.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-key list | grep Ceph 2023-09-23T07:16:51.131 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-09-23T07:16:51.156 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-23T07:16:51.156 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph.com (release key) 2023-09-23T07:16:51.156 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-09-23T07:16:51.156 INFO:teuthology.task.install.deb:Installing system (non-project) packages: fio on remote deb x86_64 2023-09-23T07:16:51.156 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e 2023-09-23T07:16:51.291 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default/ 2023-09-23T07:16:51.291 INFO:teuthology.task.install.deb:Package version is 18.0.0-6334-gee696c23-1jammy 2023-09-23T07:16:51.717 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:16:51.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-23T07:16:51.731 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2023-09-23T07:16:51.896 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-23T07:16:51.908 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-23T07:16:51.925 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-23T07:16:52.018 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-23T07:16:52.206 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy InRelease 2023-09-23T07:16:52.273 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:6 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy Release 2023-09-23T07:16:52.318 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-62891/ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/ubuntu/jammy/flavors/default jammy Release.gpg 2023-09-23T07:16:53.292 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2023-09-23T07:16:53.306 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6334-gee696c23-1jammy cephadm=18.0.0-6334-gee696c23-1jammy ceph-mds=18.0.0-6334-gee696c23-1jammy ceph-mgr=18.0.0-6334-gee696c23-1jammy ceph-common=18.0.0-6334-gee696c23-1jammy ceph-fuse=18.0.0-6334-gee696c23-1jammy ceph-test=18.0.0-6334-gee696c23-1jammy ceph-volume=18.0.0-6334-gee696c23-1jammy radosgw=18.0.0-6334-gee696c23-1jammy python3-rados=18.0.0-6334-gee696c23-1jammy python3-rgw=18.0.0-6334-gee696c23-1jammy python3-cephfs=18.0.0-6334-gee696c23-1jammy python3-rbd=18.0.0-6334-gee696c23-1jammy libcephfs2=18.0.0-6334-gee696c23-1jammy libcephfs-dev=18.0.0-6334-gee696c23-1jammy librados2=18.0.0-6334-gee696c23-1jammy librbd1=18.0.0-6334-gee696c23-1jammy rbd-fuse=18.0.0-6334-gee696c23-1jammy 2023-09-23T07:16:53.366 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2023-09-23T07:16:53.551 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2023-09-23T07:16:53.552 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2023-09-23T07:16:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:ceph is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-common is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-fuse is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-mds is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-mgr is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-test is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-volume is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:cephadm is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.712 INFO:teuthology.orchestra.run.smithi107.stdout:libcephfs-dev is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:libcephfs2 is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:librados2 is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:librbd1 is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:python3-cephfs is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:python3-rados is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:python3-rbd is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:python3-rgw is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:radosgw is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-fuse is already the newest version (18.0.0-6334-gee696c23-1jammy). 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2023-09-23T07:16:53.713 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-23T07:16:53.714 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-23T07:16:53.714 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-23T07:16:53.714 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-23T07:16:53.714 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-23T07:16:53.714 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-23T07:16:53.749 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 0 newly installed, 0 to remove and 253 not upgraded. 2023-09-23T07:16:53.750 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-23T07:16:53.752 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install fio 2023-09-23T07:16:53.810 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2023-09-23T07:16:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2023-09-23T07:16:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2023-09-23T07:16:54.117 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2023-09-23T07:16:54.117 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-09-23T07:16:54.117 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2023-09-23T07:16:54.118 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2023-09-23T07:16:54.118 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2023-09-23T07:16:54.118 INFO:teuthology.orchestra.run.smithi107.stdout: python2.7 python2.7-dev python2.7-minimal 2023-09-23T07:16:54.118 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-23T07:16:54.119 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2023-09-23T07:16:54.119 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemblk1 2023-09-23T07:16:54.120 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2023-09-23T07:16:54.121 INFO:teuthology.orchestra.run.smithi107.stdout: gnuplot gfio python-scipy 2023-09-23T07:16:54.144 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2023-09-23T07:16:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: fio libpmemblk1 2023-09-23T07:16:54.209 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 2 newly installed, 0 to remove and 253 not upgraded. 2023-09-23T07:16:54.209 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 4,112 kB of archives. 2023-09-23T07:16:54.209 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 7,813 kB of additional disk space will be used. 2023-09-23T07:16:54.209 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-09-23T07:16:54.267 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-09-23T07:16:54.741 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 4,112 kB in 0s (17.1 MB/s) 2023-09-23T07:16:54.890 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-09-23T07:16:54.993 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172896 files and directories currently installed.) 2023-09-23T07:16:54.998 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-09-23T07:16:55.081 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-09-23T07:16:55.408 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package fio. 2023-09-23T07:16:55.436 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../archives/fio_3.28-1_amd64.deb ... 2023-09-23T07:16:55.474 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking fio (3.28-1) ... 2023-09-23T07:16:56.001 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-09-23T07:16:56.147 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up fio (3.28-1) ... 2023-09-23T07:16:56.666 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-23T07:16:57.774 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-23T07:16:58.290 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-23T07:16:58.293 DEBUG:teuthology.parallel:result is None 2023-09-23T07:16:58.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e 2023-09-23T07:16:58.502 DEBUG:teuthology.orchestra.run.smithi107:> dpkg-query -W -f '${Version}' ceph 2023-09-23T07:16:58.520 INFO:teuthology.orchestra.run.smithi107.stdout:18.0.0-6334-gee696c23-1jammy 2023-09-23T07:16:58.520 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6334-gee696c23-1jammy 2023-09-23T07:16:58.520 INFO:teuthology.task.install:The correct ceph version 18.0.0-6334-gee696c23-1jammy is installed. 2023-09-23T07:16:58.521 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2023-09-23T07:16:58.521 INFO:teuthology.run_tasks:Running task workunit... 2023-09-23T07:16:58.534 INFO:tasks.workunit:Pulling workunits from ref ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e 2023-09-23T07:16:58.534 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-09-23T07:16:58.535 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2023-09-23T07:16:58.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T07:16:58.573 INFO:teuthology.orchestra.run.smithi107.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-09-23T07:16:58.573 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-09-23T07:16:58.621 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-09-23T07:16:58.621 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-09-23T07:16:58.669 INFO:tasks.workunit:timeout=3h 2023-09-23T07:16:58.669 INFO:tasks.workunit:cleanup=True 2023-09-23T07:16:58.669 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e 2023-09-23T07:16:58.719 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-09-23T07:17:55.579 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to 'ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e'. 2023-09-23T07:17:55.579 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-09-23T07:17:55.579 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-09-23T07:17:55.579 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2023-09-23T07:17:55.579 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2023-09-23T07:17:55.579 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-09-23T07:17:55.579 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2023-09-23T07:17:55.579 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2023-09-23T07:17:55.579 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-09-23T07:17:55.580 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2023-09-23T07:17:55.580 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-09-23T07:17:55.580 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2023-09-23T07:17:55.580 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-09-23T07:17:55.580 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2023-09-23T07:17:55.580 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-09-23T07:17:55.580 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-09-23T07:17:55.580 INFO:tasks.workunit.client.0.smithi107.stderr: 2023-09-23T07:17:55.580 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at ee696c23a60 qa/suites/rbd: add test to check rbd_support module recovery 2023-09-23T07:17:55.583 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-09-23T07:17:55.629 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-09-23T07:17:55.632 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-23T07:17:55.632 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-09-23T07:17:56.395 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-09-23T07:17:56.466 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-09-23T07:17:56.521 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-23T07:17:56.523 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-23T07:17:56.523 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-09-23T07:17:56.573 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-23T07:17:56.577 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-09-23T07:17:56.577 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-09-23T07:17:56.629 INFO:tasks.workunit:Running workunits matching rbd/rbd_support_module_recovery.sh on client.0... 2023-09-23T07:17:56.630 INFO:tasks.workunit:Running workunit rbd/rbd_support_module_recovery.sh... 2023-09-23T07:17:56.630 DEBUG:teuthology.orchestra.run.smithi107:workunit test rbd/rbd_support_module_recovery.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_support_module_recovery.sh 2023-09-23T07:17:56.681 INFO:tasks.workunit.client.0.smithi107.stderr:+ POOL=rbd 2023-09-23T07:17:56.681 INFO:tasks.workunit.client.0.smithi107.stderr:+ IMAGE_PREFIX=image 2023-09-23T07:17:56.681 INFO:tasks.workunit.client.0.smithi107.stderr:+ MNT_DIR_PREFIX=mnt 2023-09-23T07:17:56.681 INFO:tasks.workunit.client.0.smithi107.stderr:+ NUM_IMAGES=20 2023-09-23T07:17:56.681 INFO:tasks.workunit.client.0.smithi107.stderr:+ RUN_TIME=3600 2023-09-23T07:17:56.682 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror pool enable rbd image 2023-09-23T07:17:56.751 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror pool peer add rbd dummy 2023-09-23T07:17:56.787 INFO:tasks.workunit.client.0.smithi107.stdout:b2f497d7-26a4-450a-91fa-6075e252e43f 2023-09-23T07:17:56.791 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i = 1 )) 2023-09-23T07:17:56.791 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:17:56.791 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image1 2023-09-23T07:17:58.324 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image1 snapshot 2023-09-23T07:17:59.326 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:17:59.337 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 1m 2023-09-23T07:17:59.399 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:17:59.400 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:17:59.400 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image2 2023-09-23T07:17:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image2 snapshot 2023-09-23T07:18:00.340 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:00.349 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image2 1m 2023-09-23T07:18:00.410 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:00.410 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:00.410 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image3 2023-09-23T07:18:00.456 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image3 snapshot 2023-09-23T07:18:01.347 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:01.359 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image3 1m 2023-09-23T07:18:01.418 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:01.418 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:01.419 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image4 2023-09-23T07:18:01.464 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image4 snapshot 2023-09-23T07:18:02.360 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:02.369 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image4 1m 2023-09-23T07:18:02.431 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:02.432 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:02.432 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image5 2023-09-23T07:18:02.481 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image5 snapshot 2023-09-23T07:18:03.368 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:03.380 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image5 1m 2023-09-23T07:18:03.439 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:03.439 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:03.439 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image6 2023-09-23T07:18:03.487 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image6 snapshot 2023-09-23T07:18:04.373 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:04.383 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image6 1m 2023-09-23T07:18:04.444 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:04.444 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:04.444 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image7 2023-09-23T07:18:04.492 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image7 snapshot 2023-09-23T07:18:05.255 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:05.263 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image7 1m 2023-09-23T07:18:05.323 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:05.323 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:05.323 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image8 2023-09-23T07:18:05.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image8 snapshot 2023-09-23T07:18:06.389 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:06.398 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image8 1m 2023-09-23T07:18:06.458 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:06.458 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:06.458 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image9 2023-09-23T07:18:06.503 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image9 snapshot 2023-09-23T07:18:07.402 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:07.412 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image9 1m 2023-09-23T07:18:07.475 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:07.475 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:07.475 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image10 2023-09-23T07:18:07.522 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image10 snapshot 2023-09-23T07:18:08.406 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:08.418 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image10 1m 2023-09-23T07:18:08.480 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:08.480 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:08.480 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image11 2023-09-23T07:18:08.528 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image11 snapshot 2023-09-23T07:18:09.408 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:09.420 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image11 1m 2023-09-23T07:18:09.480 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:09.480 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:09.480 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image12 2023-09-23T07:18:09.526 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image12 snapshot 2023-09-23T07:18:10.419 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:10.430 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image12 1m 2023-09-23T07:18:10.490 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:10.490 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:10.491 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image13 2023-09-23T07:18:10.536 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image13 snapshot 2023-09-23T07:18:11.427 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:11.436 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image13 1m 2023-09-23T07:18:11.499 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:11.499 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:11.500 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image14 2023-09-23T07:18:11.546 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image14 snapshot 2023-09-23T07:18:12.436 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:12.445 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image14 1m 2023-09-23T07:18:12.508 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:12.508 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:12.508 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image15 2023-09-23T07:18:12.556 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image15 snapshot 2023-09-23T07:18:13.438 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:13.451 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image15 1m 2023-09-23T07:18:13.510 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:13.510 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:13.510 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image16 2023-09-23T07:18:13.558 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image16 snapshot 2023-09-23T07:18:14.454 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:14.462 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image16 1m 2023-09-23T07:18:14.521 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:14.521 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:14.522 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image17 2023-09-23T07:18:14.568 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image17 snapshot 2023-09-23T07:18:15.454 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:15.464 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image17 1m 2023-09-23T07:18:15.525 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:15.526 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:15.526 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image18 2023-09-23T07:18:15.575 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image18 snapshot 2023-09-23T07:18:16.470 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:16.479 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image18 1m 2023-09-23T07:18:16.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:16.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:16.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image19 2023-09-23T07:18:16.587 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image19 snapshot 2023-09-23T07:18:17.473 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:17.483 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image19 1m 2023-09-23T07:18:17.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:17.543 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:17.543 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd create --size 1G rbd/image20 2023-09-23T07:18:17.590 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror image enable rbd/image20 snapshot 2023-09-23T07:18:18.480 INFO:tasks.workunit.client.0.smithi107.stdout:Mirroring enabled 2023-09-23T07:18:18.490 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image20 1m 2023-09-23T07:18:18.552 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:18.552 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:18.552 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i = 1 )) 2023-09-23T07:18:18.552 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:18.552 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image1 2023-09-23T07:18:18.774 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd0 2023-09-23T07:18:18.775 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:18.775 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:18.775 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd0 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:18.775 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image2 2023-09-23T07:18:18.847 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd1 2023-09-23T07:18:18.847 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:18.847 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:18.847 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd1 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:18.847 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image3 2023-09-23T07:18:18.928 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd2 2023-09-23T07:18:18.928 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:18.928 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:18.928 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd2 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:18.928 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image4 2023-09-23T07:18:18.999 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd3 2023-09-23T07:18:19.000 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:19.000 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:19.000 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd3 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:19.000 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image5 2023-09-23T07:18:19.073 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd4 2023-09-23T07:18:19.073 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:19.074 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:19.074 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd4 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:19.074 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image6 2023-09-23T07:18:19.147 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd5 2023-09-23T07:18:19.147 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:19.147 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:19.147 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd5 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:19.147 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image7 2023-09-23T07:18:19.250 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd6 2023-09-23T07:18:19.250 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:19.250 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:19.250 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd6 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:19.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image8 2023-09-23T07:18:19.353 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd7 2023-09-23T07:18:19.353 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:19.353 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:19.353 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd7 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:19.354 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image9 2023-09-23T07:18:19.502 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd8 2023-09-23T07:18:19.502 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:19.503 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:19.503 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd8 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:19.503 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image10 2023-09-23T07:18:19.622 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd9 2023-09-23T07:18:19.622 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:19.622 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:19.622 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd9 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:19.628 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image11 2023-09-23T07:18:19.758 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd10 2023-09-23T07:18:19.758 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:19.758 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:19.758 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd10 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:19.761 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image12 2023-09-23T07:18:19.876 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd11 2023-09-23T07:18:19.876 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:19.876 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:19.876 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image13 2023-09-23T07:18:19.878 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd11 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd12 2023-09-23T07:18:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd12 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image14 2023-09-23T07:18:20.186 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd13 2023-09-23T07:18:20.187 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:20.187 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:20.187 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd13 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:20.187 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image15 2023-09-23T07:18:20.342 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd14 2023-09-23T07:18:20.343 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:20.343 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:20.343 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd14 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:20.343 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image16 2023-09-23T07:18:20.534 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd15 2023-09-23T07:18:20.534 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:20.535 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:20.535 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd15 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:20.540 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image17 2023-09-23T07:18:20.776 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd16 2023-09-23T07:18:20.776 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:20.776 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:20.777 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd16 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:20.777 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image18 2023-09-23T07:18:20.944 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd17 2023-09-23T07:18:20.944 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:20.944 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:20.944 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd17 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:20.945 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image19 2023-09-23T07:18:21.002 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:21.001+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:18:21.003 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:21.001+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:18:21.003 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:21.001+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:18:21.089 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd18 2023-09-23T07:18:21.090 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:21.090 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:21.090 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd18 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:21.090 INFO:tasks.workunit.client.0.smithi107.stderr:++ sudo rbd device map rbd/image20 2023-09-23T07:18:21.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:21.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:21.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:21.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:21.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:21.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:21.453 INFO:tasks.workunit.client.0.smithi107.stderr:+ DEVS[$i]=/dev/rbd19 2023-09-23T07:18:21.453 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T07:18:21.453 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 20 )) 2023-09-23T07:18:21.454 INFO:tasks.workunit.client.0.smithi107.stderr:+ sudo fio --name=fiotest --filename=/dev/rbd19 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --size=800M --iodepth=2 --runtime=43200 --time_based 2023-09-23T07:18:21.459 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:18:21.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453501 2023-09-23T07:18:21.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ END_TIME=1695457101 2023-09-23T07:18:21.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT= 2023-09-23T07:18:21.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR= 2023-09-23T07:18:21.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453501 -le 1695457101 ]] 2023-09-23T07:18:21.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z '' ]] 2023-09-23T07:18:21.461 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:18:21.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:21.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:21.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:21.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:21.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:21.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:21.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:21.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:21.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:21.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:22.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:22.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:22.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:22.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:22.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:22.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:22.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:22.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:22.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:22.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:22.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:22.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:22.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:22.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:22.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:23.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:18:23.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:23.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:23.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:23.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:23.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:23.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:23.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:23.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:23.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:23.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:23.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:23.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:24.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:24.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:24.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:24.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:24.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:24.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:24.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:24.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:24.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:24.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:24.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:24.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:25.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:25.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:25.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:25.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:25.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:25.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:25.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:25.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:25.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:25.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:26.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:26.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:26.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:26.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:26.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:26.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:26.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:26.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:26.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:26.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:26.826 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:26.825+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:18:26.826 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:26.825+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:18:26.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:26.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:26.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:26.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:26.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:26.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:26.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:26.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:27.169 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:27.169+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:18:27.169 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:27.169+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:18:27.169 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:27.169+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:18:27.857 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:27.853+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:18:28.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:28.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:28.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:28.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:28.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:28.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:28.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:28.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:28.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:28.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:28.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:28.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:28.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:28.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:28.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:28.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:28.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:28.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:28.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:28.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:29.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:29.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:29.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:29.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:29.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:29.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:29.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:29.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:29.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:29.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:29.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:29.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:29.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:29.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:29.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:29.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:29.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:29.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:29.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:29.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:29.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:29.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:29.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:29.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:29.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:29.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:29.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:29.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:29.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:29.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:29.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:29.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:29.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:29.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:29.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:29.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:29.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:29.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:29.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:30.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:30.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:30.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:30.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:31.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:31.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:31.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:31.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:31.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:31.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:31.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:31.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:31.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:31.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:31.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:31.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:31.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:31.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:31.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:31.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:31.480 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:18:31.480 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:18:31.481 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:18:31.506 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:18:32.778 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3378109360 2023-09-23T07:18:32.778 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:18:32.779 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453512 2023-09-23T07:18:32.779 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453512 -le 1695457101 ]] 2023-09-23T07:18:32.779 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3378109360 ]] 2023-09-23T07:18:32.779 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3378109360 != '' ]] 2023-09-23T07:18:32.779 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/3378109360 2023-09-23T07:18:32.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:32.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:32.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:32.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:32.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:32.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:32.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:32.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:32.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:32.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:32.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:32.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:32.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:32.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:32.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:32.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:33.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:33.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:33.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:33.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:33.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:33.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:33.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:33.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:33.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:33.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:33.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:33.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:33.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:33.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:33.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:33.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:33.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:33.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:33.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:33.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:33.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:33.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:33.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:33.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:33.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:33.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:33.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:33.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:33.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:33.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:33.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:33.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:33.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:33.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:33.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:33.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:33.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:33.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:33.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:33.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:33.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:33.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:33.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:33.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:33.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:33.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:33.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:34.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:34.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:34.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:34.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:34.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:34.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:34.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:34.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:34.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:34.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:34.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:34.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:34.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:34.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:34.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:34.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:35.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:35.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:35.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:35.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:35.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:35.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:35.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:35.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:35.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:35.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:35.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:35.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:35.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:35.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:35.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:35.259 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/3378109360 until 2023-09-23T08:18:34.439470+0000 (3600 sec) 2023-09-23T07:18:35.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:35.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:35.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:35.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:35.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:35.343 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:18:35.343 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/3378109360 2023-09-23T07:18:35.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:18:35.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:35.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:35.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:35.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:35.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:35.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:35.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:35.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:35.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:35.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:35.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:35.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:35.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:35.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:35.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:35.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:35.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:35.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:35.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:35.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:35.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:35.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:35.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:35.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:35.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:35.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:35.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:35.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:36.487 INFO:tasks.workunit.client.0.smithi107.stderr:listed 1 entries 2023-09-23T07:18:36.523 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/3378109360 2023-09-23T07:18:36.523 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:18:36.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:36.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:36.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:36.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:36.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:36.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:36.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:36.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:36.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:36.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:36.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:36.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:36.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:36.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:36.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:36.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:36.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:36.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:36.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:36.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:37.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:18:37.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:37.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:37.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:37.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:37.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:37.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:37.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:37.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:37.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:37.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:37.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:37.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:38.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:38.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:38.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:38.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:38.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:38.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:38.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:38.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:38.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:38.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:38.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:38.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:38.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:38.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:38.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:38.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:38.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:38.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:38.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:38.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:38.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:38.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:38.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:38.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:38.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:38.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:18:38.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:38.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:38.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:38.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:38.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:38.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:38.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:38.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:38.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:38.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:38.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:38.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:39.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:39.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:39.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:39.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:39.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:39.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:39.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:39.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:39.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:39.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:39.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:39.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:39.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:39.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:39.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:39.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:39.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:39.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:40.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:40.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:40.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:40.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:40.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:40.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:40.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:40.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:40.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:40.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:40.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:40.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:40.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:40.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:40.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:40.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:40.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:40.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:41.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:41.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:41.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:41.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:41.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:41.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:41.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:41.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:41.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:41.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:41.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:41.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:41.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:41.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:41.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:41.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:41.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:41.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:42.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:42.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:42.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:42.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:42.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:42.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:42.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:42.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:42.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:42.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:42.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:42.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:43.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:43.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:43.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:43.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:43.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:43.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:43.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:43.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:43.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:43.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:43.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:43.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:43.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:43.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:43.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:43.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:43.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:43.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:43.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:43.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:43.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:43.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:43.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:43.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:43.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:43.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:43.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:43.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:43.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:43.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:43.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:43.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:43.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:43.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:46.525 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:18:46.525 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:18:46.526 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:18:46.528 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:18:47.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:47.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:47.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:47.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:47.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:47.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:47.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:47.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:47.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:47.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:47.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:47.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:47.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:47.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:48.119 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2768915440 2023-09-23T07:18:48.119 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:18:48.120 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453528 2023-09-23T07:18:48.120 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453528 -le 1695457101 ]] 2023-09-23T07:18:48.120 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2768915440 ]] 2023-09-23T07:18:48.120 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2768915440 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\3\7\8\1\0\9\3\6\0 ]] 2023-09-23T07:18:48.120 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/2768915440 2023-09-23T07:18:48.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:48.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:48.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:48.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:48.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:48.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:48.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:48.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:48.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:48.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:48.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:48.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:48.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:48.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:48.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:48.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:48.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:48.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:48.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:48.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:48.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:48.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:48.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:48.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:48.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:48.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:48.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:49.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:49.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:50.306 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/2768915440 until 2023-09-23T08:18:49.667241+0000 (3600 sec) 2023-09-23T07:18:50.354 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:18:50.354 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/2768915440 2023-09-23T07:18:50.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:50.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:50.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:50.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:50.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:50.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:50.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:50.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:50.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:50.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:50.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:51.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:50.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:51.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:51.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:51.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:51.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:51.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:51.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:51.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:51.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:51.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:51.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:51.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:51.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:51.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:51.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:51.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:51.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:51.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:51.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:51.706 INFO:tasks.workunit.client.0.smithi107.stderr:listed 2 entries 2023-09-23T07:18:51.739 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/2768915440 2023-09-23T07:18:51.739 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:18:52.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:52.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:52.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:52.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:52.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:52.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:52.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:52.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:52.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:52.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:52.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:52.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:52.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:52.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:52.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:52.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:18:52.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:52.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:52.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:52.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:52.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:52.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:52.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:52.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:52.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:52.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:52.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:52.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:52.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:52.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:18:52.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:52.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:52.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:52.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:52.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:52.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:52.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:52.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:52.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:52.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:55.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:55.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:55.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:55.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:55.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:55.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:55.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:55.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:55.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:55.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:55.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:55.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:57.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:57.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:57.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:57.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:57.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:57.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:57.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:57.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:57.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:57.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:57.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:57.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:57.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:57.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:57.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:57.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:57.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:57.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:58.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:58.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:58.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:58.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:58.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:58.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:58.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:58.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:58.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:58.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:58.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:58.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:58.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:58.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:58.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:58.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:58.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:58.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:58.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:58.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:58.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:18:58.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:58.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:58.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:18:58.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:58.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:58.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:58.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:18:58.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:58.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:18:58.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:58.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:58.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:58.774 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:58.772+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:18:58.932 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:18:58.928+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:18:59.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:18:59.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:18:59.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:59.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:59.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:59.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:59.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:59.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:18:59.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:18:59.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:18:59.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:18:59.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:18:59.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:18:59.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:18:59.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:00.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:00.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:00.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:00.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:00.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:00.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:00.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:00.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:00.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:00.055 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.052+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.056 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.052+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288ae00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.056 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.052+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.057 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.052+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.057 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.052+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288a600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.057 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.052+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288b780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:00.067 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.060+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.067 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.060+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.067 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.060+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288b980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.067 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.060+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288bb80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.074 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.072+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.072+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288bd80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.072+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.072+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288bf80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.076 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.072+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.076 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.072+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13440180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.076 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.072+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.076 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.072+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13440380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.093 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.092+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.093 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.092+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13440580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.104 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.100+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.104 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.100+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.104 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.100+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.104 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.100+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288ab00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.105 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.100+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1304b300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.105 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.100+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1265e300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.118 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.116+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.118 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.116+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.118 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.116+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288b700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.118 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.116+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288b900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.118 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.116+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.118 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.116+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288bb00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.133 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.132+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.133 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.132+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288bd00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.134 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.132+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.134 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.132+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13440800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.149 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.148+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.149 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.148+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288be80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.150 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.148+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.150 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:19:00.148+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13440580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:19:00.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:00.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:00.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:00.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:00.296 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:00.292+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:00.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:00.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:00.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:00.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:00.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:00.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:01.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:01.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:01.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:01.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:01.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:01.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:01.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:01.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:01.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:01.741 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:19:01.742 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:19:01.752 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:19:01.761 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:19:01.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:01.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:01.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:01.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:01.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:01.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:01.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:01.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:01.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:02.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:02.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:02.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:02.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:02.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:02.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:02.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:02.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:02.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:02.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:02.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:02.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:02.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:02.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:02.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:02.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:03.060 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2768915440 2023-09-23T07:19:03.074 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:19:03.077 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453543 2023-09-23T07:19:03.078 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453543 -le 1695457101 ]] 2023-09-23T07:19:03.078 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2768915440 ]] 2023-09-23T07:19:03.078 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2768915440 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\7\6\8\9\1\5\4\4\0 ]] 2023-09-23T07:19:03.078 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:19:03.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:03.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:03.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:03.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:03.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:03.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:03.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:03.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:03.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:03.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:03.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:19:03.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:03.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:03.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:03.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:03.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:03.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:03.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:03.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:03.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:03.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:19:03.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:03.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:03.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:03.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:03.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:03.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:03.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:03.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:03.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:03.731 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:03.728+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:03.731 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:03.728+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:03.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:03.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:03.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:03.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:03.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:03.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:03.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:03.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:03.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:03.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:03.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:04.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:04.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:04.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:04.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:04.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:04.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:04.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:04.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:04.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:04.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:04.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:04.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:04.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:04.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:04.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:04.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:04.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:04.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:04.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:04.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:04.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:04.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:05.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:05.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:05.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:05.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:05.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:05.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:05.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:05.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:05.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:05.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:05.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:05.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:19:05.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:05.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:05.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:05.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:05.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:05.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:05.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:05.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:05.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:05.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:05.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:05.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:05.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:05.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:05.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:05.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:05.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:05.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:05.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:05.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:05.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:05.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:05.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:05.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:05.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:05.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:05.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:05.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:05.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:05.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:05.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:06.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:06.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:06.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:06.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:06.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:06.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:06.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:06.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:06.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:06.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:06.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:06.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:06.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:06.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:06.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:06.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:06.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:06.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:07.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:07.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:07.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:07.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:07.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:07.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:07.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:07.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:07.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:07.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:07.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:07.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:07.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:07.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:07.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:07.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:07.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:07.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:07.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:07.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:08.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:08.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:08.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:08.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:08.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:08.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:08.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:08.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:08.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:08.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:08.573 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:08.572+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:08.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:08.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:08.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:08.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:08.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:08.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:08.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:08.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:08.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:08.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:08.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:08.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:08.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:08.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:08.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:08.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:08.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:08.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:08.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:08.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:09.511 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:09.508+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:09.511 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:09.508+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:09.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:09.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:09.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:09.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:09.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:09.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:09.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:09.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:09.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:09.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:09.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:09.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:09.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:09.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:09.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:09.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:09.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:09.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:09.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:09.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:10.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:10.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:10.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:10.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:10.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:10.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:10.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:10.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:10.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:10.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:10.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:10.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:12.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:12.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:12.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:12.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:12.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:12.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:12.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:12.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:12.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:12.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:12.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:12.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:12.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:12.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:12.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:12.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:12.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:12.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:12.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:19:12.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:12.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:12.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:12.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:12.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:12.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:13.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:13.080 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:19:13.082 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:19:13.083 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:19:13.089 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:19:13.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:13.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:13.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:13.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:13.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:13.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:13.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:13.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:13.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:13.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:13.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:13.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:13.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:13.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:13.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:13.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:13.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:13.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:13.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:13.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:13.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:13.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:13.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:13.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:13.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:13.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:14.435 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2768915440 2023-09-23T07:19:14.440 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:19:14.441 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453554 2023-09-23T07:19:14.442 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453554 -le 1695457101 ]] 2023-09-23T07:19:14.442 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2768915440 ]] 2023-09-23T07:19:14.442 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2768915440 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\7\6\8\9\1\5\4\4\0 ]] 2023-09-23T07:19:14.442 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:19:16.497 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:16.492+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:19:16.497 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:16.492+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:16.497 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:16.492+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:17.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:17.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:17.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:17.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:17.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:17.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:17.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:17.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:17.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:17.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:17.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:17.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:17.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:17.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:17.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:17.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:17.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:17.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:18.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:18.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:18.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:18.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:18.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:18.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:18.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:18.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:18.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:18.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:18.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:18.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:18.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:18.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:18.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:18.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:18.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:18.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:18.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:18.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:18.943 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:18.940+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:19:18.951 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:18.944+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:19:18.951 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:18.948+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:19:18.952 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:18.948+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:18.952 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:18.948+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:21.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:21.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:21.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:21.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:21.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:21.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:21.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:21.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:21.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:21.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:21.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:21.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:21.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:21.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:21.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:21.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:22.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:22.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:22.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:22.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:22.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:22.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:22.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:22.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:22.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:22.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:22.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:22.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:19:22.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:22.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:22.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:22.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:22.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:22.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:22.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:22.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:22.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:22.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:22.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:22.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:23.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:23.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:23.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:23.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:23.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:23.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:23.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:23.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:23.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:23.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:23.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:23.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:23.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:23.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:23.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:23.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:23.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:23.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:24.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:24.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:24.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:24.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:24.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:24.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:24.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:24.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:24.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:24.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:24.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:24.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:24.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:24.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:24.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:24.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:24.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:24.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:24.449 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:19:24.452 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:19:24.454 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:19:24.466 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:19:25.868 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2768915440 2023-09-23T07:19:25.873 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:19:25.875 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453565 2023-09-23T07:19:25.875 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453565 -le 1695457101 ]] 2023-09-23T07:19:25.875 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2768915440 ]] 2023-09-23T07:19:25.875 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2768915440 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\7\6\8\9\1\5\4\4\0 ]] 2023-09-23T07:19:25.875 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:19:26.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:26.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:26.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:26.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:26.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:26.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:26.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:26.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:26.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:26.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:26.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:26.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:26.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:26.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:26.963 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:26.959+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:26.963 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:26.959+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:27.889 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:27.887+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:28.514 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:28.511+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:19:28.559 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:28.555+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:28.559 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:28.555+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:29.008 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:29.003+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:19:29.008 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:29.003+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:19:29.034 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:29.031+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:29.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:29.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:29.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:29.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:29.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:29.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:29.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:29.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:29.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:29.686 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:29.683+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:19:29.686 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:29.683+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:29.686 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:29.683+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:29.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:29.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:29.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:29.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:29.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:29.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:29.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:29.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:29.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:29.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:29.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:30.404 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:30.399+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:19:31.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:31.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:31.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:31.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:31.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:31.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:31.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:31.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:31.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:31.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:32.865 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:32.859+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:32.865 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:32.859+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:33.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:33.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:33.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:33.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:33.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:33.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:33.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:33.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:33.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:33.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:33.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:33.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:34.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:34.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:34.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:34.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:34.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:34.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:34.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:34.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:34.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:19:34.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:34.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:34.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:35.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:34.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:35.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:35.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:19:35.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:35.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:35.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:35.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:35.506 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:35.499+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:19:35.506 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:35.499+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:35.506 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:35.499+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:35.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:35.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:35.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:35.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:35.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:35.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:35.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:35.576 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:35.571+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:35.879 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:19:35.879 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:19:35.880 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:19:35.882 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:19:36.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:36.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:36.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:36.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:36.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:36.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:36.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:36.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:36.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:36.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:36.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:36.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:36.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:36.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:37.424 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2768915440 2023-09-23T07:19:37.424 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:19:37.425 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453577 2023-09-23T07:19:37.425 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453577 -le 1695457101 ]] 2023-09-23T07:19:37.425 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2768915440 ]] 2023-09-23T07:19:37.425 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2768915440 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\7\6\8\9\1\5\4\4\0 ]] 2023-09-23T07:19:37.425 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:19:37.473 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:37.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:19:37.473 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:37.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:19:37.473 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:37.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:19:37.473 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:37.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:37.473 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:37.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:38.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:38.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:38.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:38.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:38.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:38.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:38.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:38.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:38.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:38.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:38.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:38.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:38.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:38.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:39.278 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:39.275+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:19:39.279 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:39.275+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:39.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:39.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:39.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:39.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:39.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:39.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:39.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:39.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:39.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:39.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:39.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:39.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:39.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:39.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:39.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:39.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:41.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:41.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:41.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:41.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:41.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:41.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:41.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:41.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:41.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:41.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:41.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:41.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:41.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:41.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:41.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:41.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:41.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:41.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:41.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:41.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:41.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:41.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:41.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:41.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:41.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:41.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:41.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:41.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:41.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:41.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:42.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:42.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:42.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:42.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:42.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:42.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:42.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:19:42.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:42.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:42.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:42.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:42.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:42.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:42.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:42.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:42.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:42.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:42.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:43.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:43.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:43.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:43.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:43.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:43.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:43.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:43.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:43.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:43.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:43.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:43.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:43.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:43.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:43.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:43.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:46.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:46.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:46.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:46.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:46.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:46.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:46.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:46.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:46.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:46.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:46.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:19:46.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:46.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:46.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:46.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:46.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:46.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:46.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:46.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:46.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:46.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:46.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:46.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:46.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:46.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:46.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:46.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:46.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:46.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:46.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:46.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:46.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:46.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:47.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:47.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:47.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:47.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:47.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:47.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:47.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:47.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:47.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:47.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:47.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:47.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:47.432 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:19:47.432 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:19:47.432 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:19:47.446 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:19:48.967 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2768915440 2023-09-23T07:19:48.968 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:19:48.968 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453588 2023-09-23T07:19:48.968 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453588 -le 1695457101 ]] 2023-09-23T07:19:48.968 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2768915440 ]] 2023-09-23T07:19:48.969 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2768915440 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\7\6\8\9\1\5\4\4\0 ]] 2023-09-23T07:19:48.969 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:19:49.608 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:49.603+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:50.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:19:50.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:50.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:50.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:50.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:50.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:50.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:50.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:50.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:50.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:50.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:50.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:50.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:52.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:52.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:52.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:52.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:52.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:52.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:52.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:52.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:52.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:52.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:52.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:52.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:52.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:52.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:52.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:52.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:52.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:52.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:52.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:53.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:53.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:19:53.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:53.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:53.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:53.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:53.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:53.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:53.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:53.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:53.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:53.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:53.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:53.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:53.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:53.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:54.342 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:19:54.339+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:19:54.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:54.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:54.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:54.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:54.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:54.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:54.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:54.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:55.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:54.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:55.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:55.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:55.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:55.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:55.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:55.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:55.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:55.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:55.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:55.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:55.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:55.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:55.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:55.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:55.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:55.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:55.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:55.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:55.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:55.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:55.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:57.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:57.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:57.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:57.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:57.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:57.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:57.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:57.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:19:57.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:19:57.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:19:57.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:19:57.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:19:57.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:19:57.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:19:57.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:19:57.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:19:57.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:19:57.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:19:58.986 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:19:59.001 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:19:59.001 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:19:59.001 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:20:00.532 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1590007429 2023-09-23T07:20:00.532 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:20:00.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453600 2023-09-23T07:20:00.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453600 -le 1695457101 ]] 2023-09-23T07:20:00.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1590007429 ]] 2023-09-23T07:20:00.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1590007429 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\7\6\8\9\1\5\4\4\0 ]] 2023-09-23T07:20:00.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/1590007429 2023-09-23T07:20:01.251 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:20:01.247+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:20:03.363 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/1590007429 until 2023-09-23T08:20:02.677238+0000 (3600 sec) 2023-09-23T07:20:03.427 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:20:03.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:03.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:03.437 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/1590007429 2023-09-23T07:20:03.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:03.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:03.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:03.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:03.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:03.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:03.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:03.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:03.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:03.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:03.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:03.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:03.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:03.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:03.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:03.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:04.459 INFO:tasks.workunit.client.0.smithi107.stderr:listed 3 entries 2023-09-23T07:20:04.548 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/1590007429 2023-09-23T07:20:04.548 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:20:06.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:06.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:06.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:06.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:06.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:06.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:06.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:06.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:06.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:06.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:06.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:06.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:06.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:06.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:06.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:06.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:06.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:06.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:06.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:06.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:07.062 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:20:07.059+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:20:07.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:07.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:07.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:07.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:08.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:08.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:08.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:08.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:08.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:08.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:08.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:08.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:08.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:08.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:08.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:08.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:08.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:08.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:08.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:08.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:08.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:09.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:09.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:09.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:09.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:09.094 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:20:09.091+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:20:09.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:09.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:09.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:09.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:09.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:09.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:09.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:09.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:09.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:09.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:09.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:10.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:10.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:10.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:10.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:10.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:10.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:10.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:10.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:10.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:10.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:10.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:10.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:11.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:20:11.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:11.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:11.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:11.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:11.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:11.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:11.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:11.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:11.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:11.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:12.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:11.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:12.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:12.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:12.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:12.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:12.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:12.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:12.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:12.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:12.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:12.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:12.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:12.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:12.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:12.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:12.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:12.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:12.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:12.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:12.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:12.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:13.396 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:20:13.391+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:20:13.405 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:20:13.399+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:20:13.409 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:20:13.403+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:20:13.409 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:20:13.403+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:20:13.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:20:13.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:13.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:13.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:13.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:13.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:13.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:13.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:13.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:13.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:13.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:13.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:13.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:14.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:14.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:14.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:14.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:14.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:14.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:14.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:14.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:14.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:14.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:14.555 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:20:14.556 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:20:14.571 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:20:14.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:14.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:14.577 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:20:14.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:14.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:16.037 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1590007429 2023-09-23T07:20:16.037 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:20:16.044 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453616 2023-09-23T07:20:16.044 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453616 -le 1695457101 ]] 2023-09-23T07:20:16.045 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1590007429 ]] 2023-09-23T07:20:16.045 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1590007429 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\5\9\0\0\0\7\4\2\9 ]] 2023-09-23T07:20:16.045 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:20:16.392 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:20:16.386+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:20:18.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:18.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:18.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:18.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:18.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:18.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:18.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:18.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:18.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:18.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:18.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:18.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:18.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:18.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:18.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:18.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:18.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:18.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:20.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:20.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:20.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:20.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:20.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:20.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:20.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:20.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:20.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:20.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:20.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:20.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:20.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:20.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:20.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:20.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:20.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:20.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:20.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:20.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:20.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:20.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:21.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:21.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:21.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:21.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:21.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:21.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:21.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:21.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:21.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:21.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:21.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:21.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:21.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:21.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:21.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:21.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:21.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:21.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:21.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:21.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:21.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:21.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:22.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:22.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:22.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:22.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:22.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:22.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:22.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:22.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:22.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:22.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:22.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:22.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:22.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:22.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:22.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:22.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:20:22.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:22.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:22.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:22.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:22.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:22.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:22.887 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:20:22.882+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:20:23.788 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:20:23.782+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:20:23.788 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:20:23.782+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:20:25.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:25.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:25.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:25.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:25.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:25.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:25.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:25.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:25.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:25.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:25.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:25.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:25.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:25.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:25.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:25.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:25.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:25.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:25.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:25.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:26.048 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:20:26.048 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:20:26.050 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:20:26.050 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:20:27.467 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1590007429 2023-09-23T07:20:27.467 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:20:27.468 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453627 2023-09-23T07:20:27.468 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453627 -le 1695457101 ]] 2023-09-23T07:20:27.468 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1590007429 ]] 2023-09-23T07:20:27.468 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1590007429 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\5\9\0\0\0\7\4\2\9 ]] 2023-09-23T07:20:27.468 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:20:29.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:29.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:29.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:29.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:29.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:29.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:29.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:29.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:29.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:29.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:29.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:29.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:30.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:30.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:30.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:30.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:30.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:30.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:30.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:30.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:30.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:30.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:30.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:30.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:30.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:30.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:30.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:30.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:30.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:32.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:32.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:32.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:32.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:32.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:32.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:32.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:32.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:32.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:32.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:32.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:32.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:36.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:36.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:36.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:36.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:36.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:36.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:37.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:37.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:37.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:37.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:37.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:37.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:37.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:37.470 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:20:37.470 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:20:37.470 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:20:37.489 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:20:37.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:37.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:37.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:37.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:37.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:37.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:37.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:38.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:38.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:38.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:38.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:38.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:38.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:38.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:38.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:38.722 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1590007429 2023-09-23T07:20:38.722 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:20:38.722 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453638 2023-09-23T07:20:38.723 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453638 -le 1695457101 ]] 2023-09-23T07:20:38.723 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1590007429 ]] 2023-09-23T07:20:38.723 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1590007429 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\5\9\0\0\0\7\4\2\9 ]] 2023-09-23T07:20:38.723 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:20:39.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:39.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:39.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:39.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:39.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:39.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:39.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:39.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:39.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:39.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:39.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:39.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:39.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:39.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:39.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:39.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:39.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:39.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:39.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:39.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:40.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:40.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:40.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:40.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:40.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:40.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:40.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:40.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:40.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:40.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:40.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:40.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:40.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:40.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:40.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:40.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:40.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:40.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:40.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:40.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:40.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:41.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:41.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:41.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:41.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:41.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:41.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:41.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:41.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:41.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:41.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:41.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:41.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:41.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:41.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:41.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:41.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:41.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:41.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:41.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:41.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:42.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:42.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:42.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:42.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:42.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:42.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:42.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:42.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:42.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:42.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:42.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:20:42.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:42.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:42.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:42.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:42.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:42.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:42.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:45.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:45.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:45.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:45.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:45.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:45.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:45.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:45.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:45.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:45.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:45.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:45.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:45.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:45.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:45.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:45.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:45.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:45.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:45.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:45.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:45.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:45.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:45.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:45.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:45.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:45.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:45.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:45.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:45.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:45.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:45.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:45.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:45.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:47.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:20:47.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:47.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:47.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:47.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:47.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:47.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:47.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:47.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:47.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:47.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:47.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:48.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:48.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:48.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:48.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:48.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:48.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:48.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:48.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:48.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:48.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:48.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:48.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:48.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:48.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:48.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:48.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:48.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:48.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:48.741 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:20:48.748 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:20:48.749 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:20:48.749 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:20:50.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:50.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:50.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:50.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:50.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:50.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:50.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:50.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:50.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:50.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:50.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:50.198 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1590007429 2023-09-23T07:20:50.199 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:20:50.202 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453650 2023-09-23T07:20:50.202 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453650 -le 1695457101 ]] 2023-09-23T07:20:50.202 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1590007429 ]] 2023-09-23T07:20:50.202 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1590007429 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\5\9\0\0\0\7\4\2\9 ]] 2023-09-23T07:20:50.202 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:20:50.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:50.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:50.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:50.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:50.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:50.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:50.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:50.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:50.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:50.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:50.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:50.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:50.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:50.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:50.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:50.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:50.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:50.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:50.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:50.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:50.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:54.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:54.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:54.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:54.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:54.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:54.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:54.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:54.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:54.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:54.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:54.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:54.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:54.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:54.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:54.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:54.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:54.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:54.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:54.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:54.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:54.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:55.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:55.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:55.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:55.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:55.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:55.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:55.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:55.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:55.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:55.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:55.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:55.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:55.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:55.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:55.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:55.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:58.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:57.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:20:58.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:58.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:58.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:58.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:58.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:58.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:58.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:58.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:58.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:58.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:58.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:58.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:58.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:58.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:58.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:58.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:58.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:58.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:58.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:58.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:58.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:58.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:20:58.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:20:58.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:20:58.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:58.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:58.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:58.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:58.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:58.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:58.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:58.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:58.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:58.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:20:59.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:59.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:20:59.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:59.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:20:59.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:59.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:20:59.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:59.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:20:59.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:59.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:20:59.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:59.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:20:59.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:59.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:20:59.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:59.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:20:59.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:20:59.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:00.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:21:00.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:00.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:00.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:00.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:00.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:00.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:00.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:00.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:00.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:00.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:00.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:00.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:00.203 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:21:00.204 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:21:00.208 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:21:00.232 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:21:01.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:01.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:01.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:01.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:01.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:01.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:01.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:01.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:01.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:01.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:01.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:01.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:01.714 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1590007429 2023-09-23T07:21:01.715 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:21:01.715 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453661 2023-09-23T07:21:01.715 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453661 -le 1695457101 ]] 2023-09-23T07:21:01.716 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1590007429 ]] 2023-09-23T07:21:01.716 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1590007429 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\5\9\0\0\0\7\4\2\9 ]] 2023-09-23T07:21:01.716 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:21:01.889 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:01.878+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:21:01.890 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:01.882+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:21:01.890 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:01.882+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:21:02.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:02.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:02.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:02.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:02.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:02.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:02.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:02.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:02.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:02.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:02.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:02.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:02.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:02.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:02.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:02.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:02.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:02.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:02.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:02.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:03.160 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:03.154+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:21:03.161 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:03.154+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:21:03.161 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:03.154+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:21:03.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:03.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:03.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:03.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:03.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:03.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:03.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:03.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:03.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:03.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:03.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:03.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:03.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:03.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:03.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:03.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:03.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:03.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:03.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:03.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:03.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:04.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:04.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:04.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:04.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:04.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:04.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:04.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:04.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:04.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:04.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:04.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:04.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:06.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:06.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:06.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:06.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:06.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:06.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:06.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:06.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:06.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:06.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:06.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:06.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:06.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:06.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:06.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:06.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:06.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:06.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:06.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:06.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:06.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:06.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:06.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:06.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:06.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:06.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:06.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:06.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:06.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:06.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:06.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:06.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:06.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:06.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:06.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:06.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:06.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:06.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:06.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:06.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:06.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:06.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:06.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:06.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:06.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:07.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:21:07.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:07.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:07.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:07.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:07.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:07.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:07.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:07.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:07.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:07.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:07.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:07.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:08.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:08.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:08.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:08.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:08.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:08.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:08.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:08.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:08.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:08.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:08.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:08.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:08.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:08.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:08.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:08.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:08.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:08.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:08.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:08.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:08.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:08.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:09.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:09.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:09.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:09.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:09.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:09.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:09.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:09.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:09.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:09.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:09.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:09.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:09.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:09.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:09.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:09.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:09.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:09.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:09.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:09.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:09.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:09.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:09.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:09.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:09.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:09.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:09.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:09.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:09.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:09.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:10.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:10.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:10.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:10.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:10.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:10.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:10.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:10.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:10.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:10.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:10.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:10.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:10.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:10.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:10.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:10.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:10.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:10.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:10.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:10.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:11.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:11.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:11.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:11.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:11.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:11.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:11.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:11.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:11.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:11.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:11.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:11.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:11.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:11.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:11.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:11.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:11.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:11.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:11.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:11.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:11.725 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:21:11.725 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:21:11.729 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:21:11.736 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:21:12.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:12.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:12.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:12.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:12.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:12.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:12.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:12.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:12.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:12.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:12.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:12.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:12.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:12.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:12.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:12.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:12.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:12.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:13.081 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/542414278 2023-09-23T07:21:13.081 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:21:13.081 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453673 2023-09-23T07:21:13.082 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453673 -le 1695457101 ]] 2023-09-23T07:21:13.082 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/542414278 ]] 2023-09-23T07:21:13.082 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/542414278 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\5\9\0\0\0\7\4\2\9 ]] 2023-09-23T07:21:13.082 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/542414278 2023-09-23T07:21:13.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:13.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:13.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:13.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:13.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:13.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:13.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:13.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:13.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:13.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:13.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:13.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:13.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:13.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:13.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:13.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:13.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:13.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:14.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:14.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:14.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:14.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:14.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:14.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:14.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:14.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:14.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:14.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:14.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:14.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:15.297 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/542414278 until 2023-09-23T08:21:14.601747+0000 (3600 sec) 2023-09-23T07:21:15.364 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:21:15.364 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/542414278 2023-09-23T07:21:16.478 INFO:tasks.workunit.client.0.smithi107.stderr:listed 4 entries 2023-09-23T07:21:16.521 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/542414278 2023-09-23T07:21:16.521 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:21:17.747 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:17.742+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:21:17.747 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:17.742+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:21:20.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:20.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:20.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:20.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:20.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:20.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:20.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:20.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:20.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:20.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:20.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:20.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:20.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:20.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:20.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:20.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:21.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:21.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:21.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:21.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:21.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:21.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:21.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:21.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:21.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:21.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:21.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:21.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:21.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:21.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:21.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:21.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:21.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:21.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:22.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:22.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:22.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:22.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:22.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:22.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:22.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:22.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:22.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:22.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:22.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:22.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:22.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:22.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:22.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:22.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:22.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:22.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:22.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:22.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:24.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:21:24.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:24.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:24.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:24.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:24.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:24.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:24.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:24.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:24.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:24.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:24.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:24.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:24.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:24.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:24.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:24.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:24.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:24.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:24.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:24.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:24.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:24.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:25.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:21:25.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:25.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:25.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:25.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:25.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:25.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:25.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:25.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:25.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:25.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:25.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:25.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:25.249 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:25.246+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:21:25.250 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:25.246+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:21:25.250 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:25.246+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:21:26.527 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:21:26.530 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:21:26.532 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:21:26.542 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:21:27.989 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/542414278 2023-09-23T07:21:27.989 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:21:27.990 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453687 2023-09-23T07:21:27.990 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453687 -le 1695457101 ]] 2023-09-23T07:21:27.990 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/542414278 ]] 2023-09-23T07:21:27.990 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/542414278 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\4\2\4\1\4\2\7\8 ]] 2023-09-23T07:21:27.990 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:21:28.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:28.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:28.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:28.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:28.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:28.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:28.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:28.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:28.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:28.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:28.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:28.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:28.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:28.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:28.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:28.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:28.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:28.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:28.892 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:28.890+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:21:28.892 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:28.890+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:21:30.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:30.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:30.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:30.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:30.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:30.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:30.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:30.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:21:30.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:30.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:30.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:30.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:30.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:30.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:30.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:30.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:31.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:31.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:31.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:31.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:31.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:31.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:31.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:31.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:31.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:31.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:31.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:31.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:31.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:31.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:31.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:31.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:31.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:31.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:31.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:31.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:31.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:31.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:32.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:32.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:32.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:32.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:32.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:32.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:32.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:32.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:32.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:32.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:32.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:32.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:32.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:32.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:32.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:32.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:32.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:32.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:32.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:32.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:32.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:32.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:32.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:32.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:32.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:32.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:32.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:32.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:32.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:34.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:34.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:34.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:34.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:34.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:34.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:34.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:34.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:34.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:34.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:34.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:34.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:34.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:34.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:34.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:34.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:34.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:34.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:34.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:34.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:34.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:34.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:34.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:34.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:34.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:34.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:34.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:34.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:37.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:37.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:37.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:37.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:37.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:37.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:37.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:37.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:37.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:37.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:37.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:37.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:37.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:37.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:37.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:37.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:37.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:37.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:37.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:37.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:38.011 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:21:38.012 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:21:38.013 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:21:38.014 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:21:38.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:38.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:38.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:38.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:38.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:38.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:38.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:38.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:38.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:38.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:38.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:38.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:39.574 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/542414278 2023-09-23T07:21:39.576 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:21:39.582 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453699 2023-09-23T07:21:39.582 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453699 -le 1695457101 ]] 2023-09-23T07:21:39.582 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/542414278 ]] 2023-09-23T07:21:39.583 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/542414278 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\4\2\4\1\4\2\7\8 ]] 2023-09-23T07:21:39.583 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:21:40.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:40.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:40.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:40.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:40.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:40.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:40.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:40.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:40.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:40.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:40.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:40.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:41.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:41.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:41.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:41.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:41.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:41.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:41.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:41.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:41.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:41.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:41.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:41.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:43.596 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:43.593+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:21:43.596 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:43.593+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:21:44.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:44.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:44.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:44.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:44.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:44.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:44.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:44.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:44.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:44.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:44.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:44.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:45.663 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:45.661+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:21:45.663 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:45.661+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:21:45.663 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:45.661+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:21:45.671 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:45.669+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:21:45.671 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:45.669+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:21:45.671 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:45.669+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:21:45.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:45.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:45.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:45.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:45.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:45.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:45.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:45.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:45.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:45.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:45.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:45.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:46.308 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:21:46.305+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:21:46.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:46.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:46.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:46.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:46.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:46.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:46.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:46.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:46.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:46.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:46.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:46.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:46.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:46.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:46.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:46.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:46.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:46.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:46.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:46.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:46.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:48.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:48.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:48.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:48.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:48.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:48.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:48.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:48.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:48.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:48.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:48.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:48.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:49.587 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:21:49.587 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:21:49.597 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:21:49.599 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:21:50.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:50.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:50.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:50.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:50.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:50.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:50.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:50.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:50.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:50.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:50.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:50.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:50.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:50.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:50.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:50.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:50.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:50.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:50.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:50.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:50.946 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/542414278 2023-09-23T07:21:50.947 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:21:50.947 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453710 2023-09-23T07:21:50.947 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453710 -le 1695457101 ]] 2023-09-23T07:21:50.947 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/542414278 ]] 2023-09-23T07:21:50.948 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/542414278 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\4\2\4\1\4\2\7\8 ]] 2023-09-23T07:21:50.948 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:21:51.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:51.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:51.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:51.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:51.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:51.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:51.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:51.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:51.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:51.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:51.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:51.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:51.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:51.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:51.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:51.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:51.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:51.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:51.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:51.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:52.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:52.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:52.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:52.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:52.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:52.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:52.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:52.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:52.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:52.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:52.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:52.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:52.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:52.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:54.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:21:54.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:54.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:54.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:54.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:54.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:54.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:54.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:54.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:54.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:54.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:54.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:54.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:55.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:55.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:55.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:55.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:55.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:55.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:55.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:55.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:55.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:55.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:55.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:55.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:55.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:55.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:55.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:55.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:55.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:55.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:56.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:56.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:56.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:56.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:56.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:56.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:56.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:56.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:56.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:56.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:56.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:56.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:57.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:57.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:57.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:57.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:57.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:57.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:57.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:57.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:57.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:57.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:57.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:57.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:57.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:57.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:57.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:57.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:21:58.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:21:58.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:21:58.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:21:58.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:21:58.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:21:58.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:21:58.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:21:58.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:21:58.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:21:58.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:21:58.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:21:58.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:00.003 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.001+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.003 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.001+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12aadd00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.006 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.005+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.006 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.005+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1265e180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.008 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.005+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.008 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.005+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12df5080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.018 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.017+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.018 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.017+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1265fb00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.038 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.037+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.038 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.037+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12df5380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.051 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.049+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.051 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.049+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12aad680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.055 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.053+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.055 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.053+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12692500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.060 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.057+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.060 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.057+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12a55380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.076 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.073+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.077 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.073+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12df4b00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.095 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.093+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.095 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.093+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288ba00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.107 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.105+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.107 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.105+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1265eb80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.110 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.109+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.111 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.109+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1265ec80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.115 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.113+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.115 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.113+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12a55380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.119 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.117+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.119 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.117+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12aad680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.123 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.121+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.123 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.121+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12aadc80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.162 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.161+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.162 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.161+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12df5380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.162 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.161+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.162 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.161+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.162 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.161+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.162 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.161+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12df5a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.162 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.161+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1265f580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.162 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.161+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1304ae00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.212 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.209+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.212 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:22:00.209+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12df4e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:22:00.972 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:22:00.973 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:22:00.973 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:22:00.980 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:22:01.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:01.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:01.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:01.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:01.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:01.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:01.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:01.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:01.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:01.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:01.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:01.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:01.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:01.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:01.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:01.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:01.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:01.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:01.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:01.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:02.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:02.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:02.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:02.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:02.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:02.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:02.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:02.240 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/542414278 2023-09-23T07:22:02.241 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:22:02.242 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453722 2023-09-23T07:22:02.242 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453722 -le 1695457101 ]] 2023-09-23T07:22:02.243 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/542414278 ]] 2023-09-23T07:22:02.243 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/542414278 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\4\2\4\1\4\2\7\8 ]] 2023-09-23T07:22:02.243 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:22:02.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:02.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:02.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:02.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:02.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:02.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:02.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:04.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:04.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:04.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:04.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:04.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:04.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:04.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:04.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:04.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:04.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:04.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:04.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:04.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:04.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:04.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:06.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:06.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:06.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:06.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:06.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:06.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:06.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:06.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:06.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:06.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:22:06.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:06.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:06.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:06.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:06.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:06.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:06.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:06.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:06.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:06.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:06.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:06.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:22:06.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:06.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:06.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:06.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:06.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:06.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:06.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:06.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:06.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:06.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:06.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:07.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:07.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:07.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:07.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:07.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:07.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:07.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:07.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:07.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:07.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:07.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:07.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:07.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:07.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:07.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:07.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:07.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:07.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:07.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:07.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:22:07.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:07.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:07.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:07.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:07.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:07.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:07.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:07.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:07.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:07.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:07.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:07.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:08.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:08.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:08.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:08.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:08.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:08.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:08.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:08.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:08.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:08.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:08.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:08.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:08.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:08.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:08.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:08.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:09.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:09.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:09.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:09.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:09.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:09.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:09.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:09.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:09.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:09.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:09.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:09.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:10.377 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:10.377+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:22:11.018 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:11.017+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:22:12.251 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:22:12.252 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:22:12.252 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:22:12.280 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:22:12.749 INFO:tasks.workunit.client.0.smithi107.stderr:2023-09-23T07:22:12.749+0000 7ff86b7fe640 0 --2- 172.21.15.107:0/1553592740 >> v2:172.21.15.107:3300/0 conn(0x7ff86c070e80 0x7ff86c0893e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-23T07:22:13.808 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/542414278 2023-09-23T07:22:13.808 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:22:13.809 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453733 2023-09-23T07:22:13.809 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453733 -le 1695457101 ]] 2023-09-23T07:22:13.809 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/542414278 ]] 2023-09-23T07:22:13.809 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/542414278 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\4\2\4\1\4\2\7\8 ]] 2023-09-23T07:22:13.809 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:22:14.172 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:14.169+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:22:14.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:14.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:14.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:14.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:14.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:14.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:14.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:14.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:14.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:14.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:14.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:14.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:14.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:14.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:14.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:14.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:14.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:14.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:15.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:15.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:15.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:15.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:15.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:15.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:15.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:15.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:15.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:15.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:22:15.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:15.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:15.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:15.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:15.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:15.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:15.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:15.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:15.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:15.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:15.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:15.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:15.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:15.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:15.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:15.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:15.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:15.975 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:15.973+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:22:16.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:16.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:16.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:16.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:16.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:16.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:16.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:16.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:16.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:16.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:16.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:16.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:17.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:17.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:17.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:17.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:18.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:18.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:18.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:18.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:18.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:18.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:18.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:18.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:18.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:18.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:18.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:18.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:18.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:18.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:18.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:18.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:18.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:18.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:18.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:19.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:19.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:19.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:19.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:19.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:19.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:19.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:19.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:19.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:19.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:19.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:19.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:19.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:19.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:19.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:19.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:19.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:19.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:20.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:20.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:20.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:20.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:20.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:20.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:20.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:20.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:20.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:20.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:20.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:20.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:22.212 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:22.209+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:22:22.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:22.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:22.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:22.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:22.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:22.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:22.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:22.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:22.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:22.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:22.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:22.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:22.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:22.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:22.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:22.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:22.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:22.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:22.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:22.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:22.810 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:22:22.809+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T07:22:22.811 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:22:22.809+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:22:23.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:23.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:23.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:23.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:23.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:23.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:23.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:23.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:23.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:23.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:23.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:23.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:23.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:23.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:23.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:23.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:23.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:23.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:23.820 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:22:23.821 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:22:23.827 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:22:23.864 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:22:24.026 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:24.025+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:22:24.027 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:24.025+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:22:24.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:24.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:24.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:24.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:24.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:24.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:24.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:24.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:24.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:24.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:24.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:24.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:24.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:24.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:24.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:24.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:24.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:24.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:24.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:24.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:24.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:25.309 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1662209768 2023-09-23T07:22:25.309 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:22:25.310 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453745 2023-09-23T07:22:25.310 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453745 -le 1695457101 ]] 2023-09-23T07:22:25.310 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1662209768 ]] 2023-09-23T07:22:25.310 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1662209768 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\4\2\4\1\4\2\7\8 ]] 2023-09-23T07:22:25.310 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/1662209768 2023-09-23T07:22:25.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:25.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:25.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:25.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:25.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:25.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:25.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:25.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:25.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:25.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:25.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:25.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:26.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:26.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:26.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:26.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:26.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:26.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:26.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:26.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:27.330 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/1662209768 until 2023-09-23T08:22:26.651956+0000 (3600 sec) 2023-09-23T07:22:27.389 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:22:27.389 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/1662209768 2023-09-23T07:22:28.486 INFO:tasks.workunit.client.0.smithi107.stderr:listed 5 entries 2023-09-23T07:22:28.532 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/1662209768 2023-09-23T07:22:28.532 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:22:28.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:28.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:28.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:28.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:28.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:28.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:28.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:28.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:28.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:28.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:28.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:28.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:29.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:29.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:29.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:29.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:29.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:29.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:29.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:29.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:29.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:29.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:29.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:29.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:31.568 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:31.565+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:22:31.568 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:31.565+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:22:31.568 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:31.565+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:22:31.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:31.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:31.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:31.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:31.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:31.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:31.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:31.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:32.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:22:32.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:32.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:32.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:32.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:32.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:32.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:32.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:32.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:32.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:32.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:32.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:32.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:32.742 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:22:32.741+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:22:34.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:34.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:34.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:34.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:34.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:34.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:34.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:34.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:34.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:34.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:34.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:34.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:34.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:34.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:34.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:34.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:35.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:35.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:35.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:35.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:35.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:35.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:35.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:35.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:35.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:35.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:35.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:35.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:35.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:35.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:35.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:35.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:35.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:35.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:35.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:36.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:36.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:36.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:36.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:36.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:36.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:36.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:36.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:36.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:36.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:36.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:36.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:22:36.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:36.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:36.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:36.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:36.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:36.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:36.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:36.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:36.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:36.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:36.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:36.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:22:36.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:36.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:36.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:36.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:36.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:36.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:36.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:36.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:36.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:36.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:36.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:36.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:38.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:38.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:38.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:38.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:38.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:38.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:38.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:38.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:38.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:38.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:38.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:38.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:38.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:38.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:38.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:38.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:38.535 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:22:38.535 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:22:38.536 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:22:38.560 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:22:39.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:39.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:39.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:39.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:39.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:39.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:39.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:39.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:39.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:39.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:39.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:39.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:39.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:39.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:40.003 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1662209768 2023-09-23T07:22:40.004 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:22:40.004 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453760 2023-09-23T07:22:40.005 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453760 -le 1695457101 ]] 2023-09-23T07:22:40.005 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1662209768 ]] 2023-09-23T07:22:40.005 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1662209768 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\6\2\2\0\9\7\6\8 ]] 2023-09-23T07:22:40.005 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:22:40.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:40.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:40.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:40.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:47.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:47.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:47.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:47.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:47.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:47.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:47.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:47.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:47.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:47.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:47.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:47.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:47.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:47.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:47.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:47.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:47.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:47.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:50.006 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:22:50.006 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:22:50.012 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:22:50.012 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:22:50.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:22:50.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:50.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:50.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:50.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:50.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:50.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:50.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:50.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:50.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:50.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:50.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:50.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:50.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:50.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:50.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:50.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:50.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:50.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:50.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:51.469 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1662209768 2023-09-23T07:22:51.482 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:22:51.483 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453771 2023-09-23T07:22:51.483 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453771 -le 1695457101 ]] 2023-09-23T07:22:51.483 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1662209768 ]] 2023-09-23T07:22:51.483 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1662209768 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\6\2\2\0\9\7\6\8 ]] 2023-09-23T07:22:51.483 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:22:54.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:54.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:54.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:54.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:54.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:54.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:54.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:54.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:54.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:54.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:54.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:54.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:56.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:56.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:56.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:56.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:56.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:56.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:56.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:56.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:56.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:56.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:56.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:56.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:56.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:56.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:56.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:56.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:56.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:56.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:22:57.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:57.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:57.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:57.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:57.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:57.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:57.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:57.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:57.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:57.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:22:57.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:57.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:57.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:57.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:57.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:57.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:57.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:57.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:57.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:57.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:22:59.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:59.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:22:59.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:59.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:22:59.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:59.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:22:59.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:59.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:22:59.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:59.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:22:59.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:59.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:22:59.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:59.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:22:59.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:59.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:22:59.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:22:59.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:00.078 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.073+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.078 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.073+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d12a55100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.078 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.077+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.078 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.077+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d1288ac00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.082 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.081+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.082 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.081+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e2180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.084 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.081+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.084 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.081+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d1265ef80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.098 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.098 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.098 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.098 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.098 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.098 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.098 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e2480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.098 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e2680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.098 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e2c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.099 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e2b00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.099 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e3200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.099 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.097+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e3080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.105 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.105+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.105 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.105+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d12a55100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.112 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.109+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.112 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.109+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d1288ac00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.113 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.113+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.113 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.113+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e2180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.133 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.133+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.133 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.133+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.133 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.133+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d1265ef80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.133 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.133+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e2480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.144 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.141+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.144 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.141+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e2680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.144 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.141+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.144 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.141+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e2c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.144 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.145+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.145 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.145+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e2b00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.151 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.149+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.151 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.149+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.151 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.149+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e3200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:00.151 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:23:00.149+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d132e3080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:23:01.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:01.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:01.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:01.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:01.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:01.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:01.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:01.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:01.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:01.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:01.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:01.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:01.487 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:23:01.488 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:23:01.493 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:23:01.493 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:23:01.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:01.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:01.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:01.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:01.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:23:01.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:01.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:01.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:01.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:01.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:02.772 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1662209768 2023-09-23T07:23:02.781 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:23:02.782 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453782 2023-09-23T07:23:02.782 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453782 -le 1695457101 ]] 2023-09-23T07:23:02.782 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1662209768 ]] 2023-09-23T07:23:02.782 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1662209768 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\6\2\2\0\9\7\6\8 ]] 2023-09-23T07:23:02.782 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:23:03.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:03.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:03.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:03.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:03.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:03.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:03.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:03.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:03.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:03.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:03.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:03.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:03.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:03.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:03.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:03.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:03.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:03.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:03.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:03.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:04.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:04.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:04.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:04.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:04.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:04.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:04.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:04.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:04.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:04.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:04.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:04.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:04.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:04.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:06.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:06.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:06.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:06.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:06.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:06.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:06.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:06.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:06.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:06.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:06.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:06.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:06.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:06.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:06.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:06.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:06.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:06.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:06.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:06.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:07.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:07.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:07.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:07.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:07.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:07.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:07.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:07.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:07.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:07.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:07.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:07.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:07.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:07.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:07.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:07.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:07.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:07.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:07.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:07.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:08.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:08.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:08.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:08.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:08.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:08.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:08.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:08.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:08.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:08.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:23:08.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:08.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:08.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:08.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:08.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:08.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:08.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:08.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:08.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:08.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:08.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:09.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:09.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:10.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:10.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:23:10.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:10.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:10.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:10.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:10.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:10.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:10.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:10.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:10.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:10.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:10.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:10.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:10.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:10.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:10.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:10.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:12.784 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:23:12.786 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:23:12.787 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:23:12.802 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:23:12.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:23:12.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:12.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:12.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:12.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:12.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:12.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:12.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:12.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:12.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:12.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:12.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:13.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:13.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:13.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:13.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:13.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:13.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:13.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:13.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:13.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:13.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:13.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:13.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:13.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:14.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1662209768 2023-09-23T07:23:14.370 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:23:14.371 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453794 2023-09-23T07:23:14.371 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453794 -le 1695457101 ]] 2023-09-23T07:23:14.371 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1662209768 ]] 2023-09-23T07:23:14.371 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1662209768 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\6\2\2\0\9\7\6\8 ]] 2023-09-23T07:23:14.371 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:23:15.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:15.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:15.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:15.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:15.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:15.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:15.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:15.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:15.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:15.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:15.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:15.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:15.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:15.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:15.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:15.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:16.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:16.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:16.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:16.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:16.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:16.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:16.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:16.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:16.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:16.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:16.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:16.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:17.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:17.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:17.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:17.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:17.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:17.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:17.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:17.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:17.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:17.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:17.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:17.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:17.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:17.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:17.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:17.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:18.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:18.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:18.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:18.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:18.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:18.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:18.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:18.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:18.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:18.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:18.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:18.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:18.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:18.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:18.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:18.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:19.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:19.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:19.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:19.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:19.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:19.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:19.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:19.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:19.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:19.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:19.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:19.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:19.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:19.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:19.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:19.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:19.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:19.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:23:19.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:19.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:19.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:19.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:19.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:19.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:19.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:19.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:19.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:19.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:19.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:19.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:19.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:19.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:19.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:19.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:19.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:19.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:19.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:20.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:20.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:20.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:20.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:20.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:20.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:20.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:20.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:20.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:20.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:20.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:20.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:22.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:22.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:22.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:22.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:22.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:22.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:22.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:22.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:22.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:22.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:22.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:22.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:22.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:22.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:22.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:24.222 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:23:24.216+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:23:24.223 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:23:24.216+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:23:24.223 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:23:24.216+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:23:24.376 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:23:24.377 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:23:24.378 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:23:24.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:24.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:24.418 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:23:24.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:24.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:24.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:24.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:24.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:24.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:24.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:24.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:24.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:24.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:24.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:24.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:24.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:24.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:24.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:24.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:24.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:24.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:25.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:25.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:25.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:25.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:25.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:25.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:25.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:25.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:25.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:25.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:25.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:25.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:25.946 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1662209768 2023-09-23T07:23:25.947 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:23:25.948 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453805 2023-09-23T07:23:25.948 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453805 -le 1695457101 ]] 2023-09-23T07:23:25.948 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1662209768 ]] 2023-09-23T07:23:25.948 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1662209768 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\6\2\2\0\9\7\6\8 ]] 2023-09-23T07:23:25.948 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:23:26.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:26.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:26.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:26.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:26.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:26.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:26.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:26.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:26.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:26.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:26.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:26.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:26.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:26.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:26.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:26.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:27.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:27.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:27.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:27.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:27.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:27.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:27.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:27.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:27.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:27.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:27.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:27.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:27.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:27.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:27.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:27.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:27.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:27.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:27.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:27.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:29.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:29.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:29.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:29.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:29.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:29.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:29.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:29.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:29.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:29.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:29.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:29.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:29.652 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:23:29.648+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:23:29.652 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:23:29.648+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:23:30.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:30.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:30.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:30.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:30.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:30.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:30.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:30.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:30.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:30.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:30.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:30.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:30.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:30.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:30.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:30.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:30.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:30.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:33.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:33.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:33.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:33.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:33.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:33.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:33.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:33.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:33.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:33.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:33.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:33.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:33.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:33.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:33.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:33.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:34.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:34.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:34.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:34.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:34.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:34.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:34.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:34.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:34.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:34.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:34.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:34.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:34.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:34.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:34.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:34.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:34.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:34.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:34.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:34.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:35.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:35.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:35.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:35.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:35.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:35.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:35.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:35.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:35.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:35.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:35.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:35.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:35.953 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:23:35.953 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:23:35.956 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:23:35.963 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:23:37.444 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/520668625 2023-09-23T07:23:37.444 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:23:37.445 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453817 2023-09-23T07:23:37.445 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453817 -le 1695457101 ]] 2023-09-23T07:23:37.445 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/520668625 ]] 2023-09-23T07:23:37.445 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/520668625 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\6\2\2\0\9\7\6\8 ]] 2023-09-23T07:23:37.445 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/520668625 2023-09-23T07:23:38.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:38.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:38.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:38.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:38.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:38.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:38.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:38.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:38.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:38.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:38.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:38.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:38.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:38.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:38.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:38.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:38.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:38.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:39.377 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/520668625 until 2023-09-23T08:23:38.673472+0000 (3600 sec) 2023-09-23T07:23:39.435 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:23:39.439 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/520668625 2023-09-23T07:23:40.767 INFO:tasks.workunit.client.0.smithi107.stderr:listed 6 entries 2023-09-23T07:23:40.789 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/520668625 2023-09-23T07:23:40.789 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:23:41.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:41.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:41.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:41.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:41.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:41.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:41.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:41.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:41.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:41.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:41.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:41.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:42.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:42.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:42.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:42.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:42.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:42.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:42.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:42.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:42.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:42.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:42.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:42.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:42.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:42.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:42.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:42.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:42.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:42.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:42.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:42.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:43.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:43.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:43.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:43.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:43.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:43.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:43.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:43.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:43.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:43.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:43.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:43.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:43.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:43.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:43.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:43.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:43.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:43.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:44.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:44.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:44.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:44.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:44.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:44.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:44.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:44.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:44.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:44.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:44.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:44.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:44.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:44.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:44.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:44.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:44.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:44.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:45.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:45.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:45.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:45.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:45.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:45.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:45.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:45.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:45.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:45.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:45.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:45.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:45.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:45.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:45.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:45.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:45.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:45.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:45.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:45.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:45.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:45.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:47.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:47.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:47.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:47.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:47.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:47.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:47.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:47.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:47.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:47.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:47.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:47.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:47.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:47.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:47.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:49.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:49.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:49.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:49.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:49.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:49.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:49.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:49.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:49.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:49.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:49.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:23:49.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:49.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:49.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:49.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:49.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:49.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:49.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:49.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:49.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:50.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:50.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:50.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:50.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:50.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:50.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:50.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:50.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:50.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:50.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:50.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:50.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:50.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:50.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:50.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:50.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:50.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:50.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:50.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:50.794 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:23:50.796 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:23:50.799 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:23:50.810 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:23:51.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:23:51.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:23:51.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:51.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:51.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:51.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:51.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:51.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:51.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:51.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:51.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:51.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:52.024 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/520668625 2023-09-23T07:23:52.024 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:23:52.029 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453832 2023-09-23T07:23:52.029 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453832 -le 1695457101 ]] 2023-09-23T07:23:52.029 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/520668625 ]] 2023-09-23T07:23:52.029 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/520668625 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\2\0\6\6\8\6\2\5 ]] 2023-09-23T07:23:52.029 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:23:53.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:53.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:53.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:53.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:53.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:53.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:53.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:53.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:53.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:53.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:53.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:53.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:53.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:53.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:57.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:57.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:57.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:57.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:57.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:57.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:57.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:57.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:57.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:57.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:57.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:57.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:57.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:57.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:57.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:59.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:59.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:23:59.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:59.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:23:59.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:59.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:23:59.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:59.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:23:59.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:59.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:23:59.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:59.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:23:59.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:59.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:23:59.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:59.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:23:59.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:23:59.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:23:59.199 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:23:59.196+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:23:59.224 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:23:59.220+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:23:59.226 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:23:59.224+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:23:59.226 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:23:59.224+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:23:59.226 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:23:59.224+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:24:00.099 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.096+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.099 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.096+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.099 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.096+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12693d80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.099 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.096+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1304a600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.126 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.124+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.126 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.124+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288b880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.142 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.140+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.142 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.140+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1304b900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.145 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.140+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.145 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.140+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288a480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.145 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.144+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.146 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.144+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d132e2480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.152 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.148+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.152 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.148+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d132e3800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.156+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.156+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.156+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.156+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d132e3680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.156+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d132e3d80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.156+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d132e3c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.220 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.216+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.220 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.216+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12693d80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.225 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.224+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.225 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.224+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1304a600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.243 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.240+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.243 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.240+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288b880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.255 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.252+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.255 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.252+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1304b900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.256 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.252+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.256 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.252+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288a480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.274 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.272+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.274 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.272+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d132e2480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.293 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.292+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.293 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.292+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d132e3800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.294 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.292+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.294 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.292+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d132e3680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.302 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.300+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.302 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.300+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d132e3d80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.312 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.308+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:00.312 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:00.308+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d132e3c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:24:01.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:01.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:01.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:01.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:01.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:01.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:01.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:01.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:01.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:01.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:01.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:01.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:01.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:01.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:01.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:01.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:01.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:01.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:01.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:01.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:02.039 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:24:02.042 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:24:02.042 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:24:02.048 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:24:03.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/520668625 2023-09-23T07:24:03.541 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:24:03.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453843 2023-09-23T07:24:03.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453843 -le 1695457101 ]] 2023-09-23T07:24:03.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/520668625 ]] 2023-09-23T07:24:03.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/520668625 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\2\0\6\6\8\6\2\5 ]] 2023-09-23T07:24:03.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:24:05.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:05.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:05.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:05.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:05.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:05.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:05.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:05.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:05.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:05.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:05.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:05.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:05.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:05.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:06.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:06.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:06.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:06.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:06.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:06.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:06.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:06.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:06.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:06.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:06.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:06.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:06.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:06.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:06.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:06.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:06.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:06.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:06.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:06.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:06.639 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:06.636+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:24:06.640 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:06.636+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:24:06.640 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:06.636+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:24:06.659 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:06.656+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:24:06.659 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:06.656+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:24:07.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:24:07.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:07.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:07.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:07.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:07.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:07.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:07.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:07.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:07.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:07.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:07.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:07.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:07.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:07.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:07.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:07.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:07.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:07.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:07.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:07.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:08.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:08.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:08.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:08.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:08.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:08.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:08.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:08.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:08.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:08.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:08.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:08.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:09.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:09.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:09.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:09.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:09.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:09.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:09.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:09.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:09.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:09.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:09.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:09.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:09.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:09.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:09.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:09.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:10.348 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:10.344+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:24:10.365 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:10.364+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:24:10.366 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:10.364+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:24:10.366 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:10.364+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:24:12.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:24:12.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:12.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:12.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:12.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:12.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:12.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:12.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:12.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:12.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:12.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:12.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:12.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:13.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:13.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:13.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:13.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:13.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:24:13.551 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:24:13.553 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:24:13.564 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:24:13.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:13.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:13.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:13.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:13.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:13.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:13.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:13.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:13.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:15.158 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/520668625 2023-09-23T07:24:15.159 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:24:15.159 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453855 2023-09-23T07:24:15.159 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453855 -le 1695457101 ]] 2023-09-23T07:24:15.159 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/520668625 ]] 2023-09-23T07:24:15.159 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/520668625 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\2\0\6\6\8\6\2\5 ]] 2023-09-23T07:24:15.159 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:24:16.042 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:16.040+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:24:16.042 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:16.040+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:24:16.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:16.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:16.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:16.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:16.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:16.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:16.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:16.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:16.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:16.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:16.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:16.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:16.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:16.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:16.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:16.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:16.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:16.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:16.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:16.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:17.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:17.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:17.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:17.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:17.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:17.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:17.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:17.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:17.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:17.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:17.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:17.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:17.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:17.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:17.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:17.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:17.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:17.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:17.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:17.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:19.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:19.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:19.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:19.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:19.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:19.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:19.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:19.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:19.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:19.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:19.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:19.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:19.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:19.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:19.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:19.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:19.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:19.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:19.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:19.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:19.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:19.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:19.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:21.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:21.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:21.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:21.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:21.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:21.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:21.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:21.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:21.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:21.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:21.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:21.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:21.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:21.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:21.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:21.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:21.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:21.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:21.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:21.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:22.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:22.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:22.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:22.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:22.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:22.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:22.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:22.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:22.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:22.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:22.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:22.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:22.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:22.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:22.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:22.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:22.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:22.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:25.174 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:24:25.178 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:24:25.183 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:24:25.189 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:24:25.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:25.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:25.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:25.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:25.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:25.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:25.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:25.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:25.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:25.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:25.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:25.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:25.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:25.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:25.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:26.710 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/520668625 2023-09-23T07:24:26.716 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:24:26.717 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453866 2023-09-23T07:24:26.717 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453866 -le 1695457101 ]] 2023-09-23T07:24:26.717 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/520668625 ]] 2023-09-23T07:24:26.718 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/520668625 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\2\0\6\6\8\6\2\5 ]] 2023-09-23T07:24:26.718 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:24:28.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:28.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:28.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:28.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:28.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:28.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:28.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:28.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:28.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:28.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:28.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:28.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:28.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:28.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:28.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:28.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:28.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:28.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:30.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:30.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:30.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:30.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:30.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:30.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:30.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:30.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:30.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:30.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:30.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:30.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:30.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:30.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:30.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:30.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:31.393 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:31.391+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:24:32.649 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:32.643+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:24:33.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:33.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:33.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:33.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:33.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:33.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:33.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:33.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:33.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:33.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:33.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:33.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:33.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:33.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:33.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:33.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:33.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:33.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:33.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:33.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:35.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:35.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:35.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:35.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:35.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:35.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:35.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:35.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:35.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:35.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:35.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:35.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:35.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:35.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:36.732 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:24:36.732 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:24:36.732 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:24:36.736 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:24:37.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:37.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:37.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:37.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:37.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:37.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:37.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:37.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:37.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:37.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:37.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:37.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:37.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:37.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:37.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:37.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:38.077 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/520668625 2023-09-23T07:24:38.085 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:24:38.085 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453878 2023-09-23T07:24:38.085 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453878 -le 1695457101 ]] 2023-09-23T07:24:38.085 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/520668625 ]] 2023-09-23T07:24:38.086 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/520668625 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\2\0\6\6\8\6\2\5 ]] 2023-09-23T07:24:38.086 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:24:38.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:38.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:38.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:38.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:38.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:38.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:38.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:38.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:38.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:38.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:38.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:38.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:38.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:38.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:38.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:38.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:38.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:38.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:38.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:38.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:39.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:39.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:39.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:39.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:39.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:39.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:39.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:39.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:39.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:39.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:39.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:39.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:39.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:39.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:24:39.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:39.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:39.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:39.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:39.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:39.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:44.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:44.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:44.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:44.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:44.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:44.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:44.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:44.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:44.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:44.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:44.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:44.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:44.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:44.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:44.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:44.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:44.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:44.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:44.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:44.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:44.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:45.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:45.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:45.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:45.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:45.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:45.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:45.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:45.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:45.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:45.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:45.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:45.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:45.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:45.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:45.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:45.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:47.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:47.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:47.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:47.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:47.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:47.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:47.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:47.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:47.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:47.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:47.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:47.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:47.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:47.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:47.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:47.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:47.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:47.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:47.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:47.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:47.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:47.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:47.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:47.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:47.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:47.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:47.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:47.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:48.087 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:24:48.087 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:24:48.091 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:24:48.119 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:24:49.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:49.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:49.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:49.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:49.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:49.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:49.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:49.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:49.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:49.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:49.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:49.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:49.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:49.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:49.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:49.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:49.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:49.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:49.497 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/82994300 2023-09-23T07:24:49.498 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:24:49.498 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453889 2023-09-23T07:24:49.498 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453889 -le 1695457101 ]] 2023-09-23T07:24:49.498 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/82994300 ]] 2023-09-23T07:24:49.498 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/82994300 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\5\2\0\6\6\8\6\2\5 ]] 2023-09-23T07:24:49.498 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/82994300 2023-09-23T07:24:50.142 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:50.139+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:24:50.142 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:50.139+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:24:51.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:51.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:51.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:51.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:51.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:51.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:51.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:51.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:51.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:51.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:51.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:51.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:51.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:51.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:51.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:51.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:51.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:51.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:51.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:51.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:51.469 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/82994300 until 2023-09-23T08:24:50.796618+0000 (3600 sec) 2023-09-23T07:24:51.545 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/82994300 2023-09-23T07:24:51.548 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:24:52.739 INFO:tasks.workunit.client.0.smithi107.stderr:listed 7 entries 2023-09-23T07:24:52.775 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/82994300 2023-09-23T07:24:52.775 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:24:53.646 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:53.643+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:24:53.646 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:53.643+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:24:55.134 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:24:55.131+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:24:56.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:56.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:56.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:56.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:56.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:56.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:56.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:56.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:56.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:56.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:56.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:56.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:56.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:57.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:57.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:57.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:57.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:57.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:57.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:57.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:57.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:57.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:57.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:57.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:57.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:57.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:57.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:57.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:57.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:57.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:57.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:58.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:58.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:58.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:58.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:58.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:58.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:58.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:58.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:58.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:58.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:58.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:58.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:58.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:58.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:58.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:58.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:58.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:58.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:24:59.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:24:59.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:24:59.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:24:59.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:24:59.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:24:59.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:24:59.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:24:59.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:24:59.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:24:59.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:24:59.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:24:59.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:00.004 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:59.999+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.004 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:24:59.999+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13657e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.013 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.011+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.013 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.011+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13634080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.013 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.011+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.013 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.011+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13634280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.041 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.039+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.042 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.039+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13634480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.042 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.039+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.042 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.039+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13634a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.044 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.043+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.044 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.043+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13634880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.062 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.059+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.063 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.059+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13634700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.071 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.067+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.072 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.067+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13634c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.095 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.091+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.095 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.091+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13634e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.096 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.091+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.096 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.091+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13635080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.101 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.099+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.102 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.099+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13635280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.118 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.115+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.118 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.115+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.118 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.115+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13635a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.118 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.115+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13635900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.134 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.131+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.134 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.131+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.134 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.131+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.134 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.131+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.134 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.131+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13635700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.134 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.131+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13635480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.131+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13635c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.135 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.131+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13635e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.149 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.147+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.150 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.147+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1365c080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.157 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.155+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.157 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.155+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1365c280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.194 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.191+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.195 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:25:00.191+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1365c480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:25:00.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:00.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:00.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:00.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:00.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:00.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:00.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:00.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:00.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:00.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:00.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:00.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:00.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:00.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:00.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:00.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:00.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:00.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:00.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:00.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:01.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:01.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:01.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:01.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:01.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:01.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:01.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:01.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:01.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:01.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:01.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:01.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:01.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:01.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:01.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:02.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:02.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:02.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:02.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:02.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:02.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:02.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:02.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:02.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:02.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:02.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:02.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:02.794 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:25:02.798 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:25:02.804 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:25:02.817 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:25:04.179 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/82994300 2023-09-23T07:25:04.179 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:25:04.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453904 2023-09-23T07:25:04.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453904 -le 1695457101 ]] 2023-09-23T07:25:04.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/82994300 ]] 2023-09-23T07:25:04.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/82994300 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\8\2\9\9\4\3\0\0 ]] 2023-09-23T07:25:04.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:25:04.429 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:04.427+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:25:04.429 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:04.427+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:25:04.429 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:04.427+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:25:05.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:05.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:05.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:05.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:05.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:05.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:05.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:05.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:05.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:05.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:05.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:05.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:05.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:05.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:05.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:05.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:05.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:05.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:05.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:05.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:05.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:05.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:06.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:06.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:06.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:06.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:06.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:06.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:06.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:06.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:06.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:06.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:06.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:06.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:06.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:06.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:06.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:06.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:06.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:06.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:06.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:06.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:07.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:25:07.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:07.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:07.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:07.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:07.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:07.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:07.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:07.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:07.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:07.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:07.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:07.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:07.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:07.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:07.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:07.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:07.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:07.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:07.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:07.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:07.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:07.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:08.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:08.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:08.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:08.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:08.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:08.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:08.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:08.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:08.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:08.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:08.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:08.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:08.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:08.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:08.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:08.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:08.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:08.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:08.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:08.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:09.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:09.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:09.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:09.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:09.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:09.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:09.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:09.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:09.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:09.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:09.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:09.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:09.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:09.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:09.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:09.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:09.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:09.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:09.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:09.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:10.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:10.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:10.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:10.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:10.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:10.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:10.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:10.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:10.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:10.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:10.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:10.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:25:10.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:10.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:10.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:10.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:10.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:10.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:10.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:10.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:10.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:10.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:10.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:10.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:25:10.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:10.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:10.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:10.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:10.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:10.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:10.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:10.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:10.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:10.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:10.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:10.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:13.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:13.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:13.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:13.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:13.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:13.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:13.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:13.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:13.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:13.183 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:13.179+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:25:13.183 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:13.179+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:25:13.184 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:13.179+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:25:13.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:13.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:13.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:13.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:13.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:13.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:13.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:13.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:13.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:13.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:13.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:13.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:13.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:13.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:13.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:13.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:13.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:14.182 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:25:14.182 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:25:14.182 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:25:14.184 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:25:14.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:14.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:14.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:14.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:14.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:14.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:14.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:14.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:14.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:14.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:14.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:14.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:14.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:14.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:14.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:14.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:14.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:14.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:14.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:14.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:15.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:15.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:15.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:15.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:15.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:15.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:15.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:15.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:15.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:15.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:15.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:15.686 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/82994300 2023-09-23T07:25:15.687 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:25:15.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453915 2023-09-23T07:25:15.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453915 -le 1695457101 ]] 2023-09-23T07:25:15.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/82994300 ]] 2023-09-23T07:25:15.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/82994300 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\8\2\9\9\4\3\0\0 ]] 2023-09-23T07:25:15.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:25:15.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:15.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:15.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:15.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:15.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:15.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:15.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:15.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:16.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:16.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:16.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:16.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:16.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:16.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:16.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:16.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:16.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:16.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:16.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:16.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:16.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:16.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:16.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:16.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:16.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:16.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:16.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:16.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:16.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:16.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:19.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:19.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:25:19.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:19.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:19.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:19.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:19.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:19.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:19.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:19.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:19.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:19.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:19.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:19.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:19.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:19.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:19.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:19.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:19.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:19.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:20.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:20.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:20.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:20.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:20.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:20.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:20.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:25:20.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:20.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:20.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:20.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:20.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:20.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:20.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:20.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:20.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:20.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:20.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:20.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:21.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:21.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:21.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:21.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:21.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:21.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:21.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:21.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:21.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:21.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:21.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:21.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:22.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:22.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:22.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:22.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:22.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:22.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:22.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:22.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:22.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:22.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:22.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:22.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:23.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:25:23.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:23.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:23.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:23.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:23.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:23.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:23.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:23.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:23.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:23.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:23.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:23.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:23.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:23.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:23.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:23.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:23.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:23.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:23.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:23.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:23.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:23.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:23.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:23.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:23.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:23.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:23.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:23.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:23.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:23.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:23.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:23.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:23.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:25.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:25.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:25.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:25.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:25.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:25.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:25.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:25.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:25.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:25.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:25.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:25.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:25.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:25.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:25.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:25.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:25.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:25.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:25.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:25.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:25.696 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:25:25.696 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:25:25.697 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:25:25.719 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:25:27.368 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/82994300 2023-09-23T07:25:27.368 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:25:27.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453927 2023-09-23T07:25:27.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453927 -le 1695457101 ]] 2023-09-23T07:25:27.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/82994300 ]] 2023-09-23T07:25:27.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/82994300 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\8\2\9\9\4\3\0\0 ]] 2023-09-23T07:25:27.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:25:27.624 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:27.623+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:25:27.625 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:27.623+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:25:27.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:27.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:27.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:27.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:28.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:28.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:28.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:28.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:28.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:28.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:28.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:28.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:28.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:28.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:28.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:28.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:28.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:28.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:28.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:28.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:28.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:28.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:29.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:29.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:29.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:29.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:29.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:29.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:29.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:29.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:29.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:29.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:29.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:29.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:29.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:31.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:31.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:31.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:31.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:31.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:31.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:31.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:31.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:31.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:31.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:31.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:31.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:31.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:31.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:31.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:31.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:31.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:31.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:31.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:31.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:34.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:34.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:34.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:34.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:34.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:34.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:34.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:34.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:34.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:34.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:34.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:34.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:34.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:34.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:34.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:34.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:34.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:34.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:34.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:34.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:36.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:36.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:36.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:36.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:36.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:36.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:36.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:36.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:36.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:36.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:37.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:36.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:37.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:36.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:37.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:37.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:37.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:37.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:37.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:37.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:37.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:37.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:37.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:37.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:37.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:37.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:37.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:37.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:37.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:37.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:37.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:37.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:37.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:37.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:37.376 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:25:37.376 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:25:37.388 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:25:37.388 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:25:38.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:38.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:38.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:38.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:38.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:38.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:38.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:38.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:38.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:38.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:38.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:38.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:38.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:38.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:38.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:38.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:38.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:38.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:38.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:38.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:38.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:39.023 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/82994300 2023-09-23T07:25:39.023 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:25:39.024 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453939 2023-09-23T07:25:39.024 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453939 -le 1695457101 ]] 2023-09-23T07:25:39.025 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/82994300 ]] 2023-09-23T07:25:39.025 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/82994300 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\8\2\9\9\4\3\0\0 ]] 2023-09-23T07:25:39.025 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:25:39.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:39.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:39.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:39.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:39.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:39.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:39.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:39.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:39.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:39.427 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:39.419+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:25:39.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:39.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:39.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:39.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:39.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:39.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:39.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:40.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:40.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:40.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:40.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:40.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:40.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:40.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:40.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:40.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:40.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:40.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:40.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:40.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:40.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:40.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:41.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:25:41.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:41.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:41.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:41.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:41.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:41.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:41.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:41.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:41.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:41.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:41.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:41.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:44.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:44.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:44.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:44.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:44.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:44.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:44.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:44.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:44.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:44.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:44.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:44.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:44.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:44.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:46.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:25:46.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:46.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:46.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:46.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:46.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:46.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:46.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:46.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:46.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:46.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:46.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:46.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:46.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:46.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:46.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:46.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:46.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:49.044 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:25:49.044 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:25:49.044 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:25:49.044 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:25:50.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:50.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:50.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:50.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:50.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:50.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:50.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:50.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:50.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:50.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:50.439 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/82994300 2023-09-23T07:25:50.439 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:25:50.441 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453950 2023-09-23T07:25:50.441 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453950 -le 1695457101 ]] 2023-09-23T07:25:50.441 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/82994300 ]] 2023-09-23T07:25:50.441 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/82994300 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\8\2\9\9\4\3\0\0 ]] 2023-09-23T07:25:50.441 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:25:50.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:50.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:50.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:50.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:50.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:50.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:50.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:50.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:51.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:51.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:51.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:51.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:51.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:51.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:51.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:51.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:51.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:51.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:51.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:51.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:51.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:51.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:51.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:51.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:51.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:51.800 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:51.794+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:25:51.800 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:51.794+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:25:51.800 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:25:51.794+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:25:52.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:52.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:52.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:52.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:52.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:52.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:52.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:52.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:52.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:52.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:52.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:52.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:52.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:52.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:52.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:52.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:52.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:52.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:52.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:52.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:55.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:55.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:55.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:55.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:55.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:55.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:55.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:55.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:55.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:55.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:55.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:55.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:55.232 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:25:55.230+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:25:56.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:56.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:56.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:56.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:56.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:56.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:56.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:56.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:56.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:56.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:56.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:56.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:56.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:56.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:56.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:56.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:56.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:56.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:56.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:57.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:57.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:57.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:57.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:57.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:57.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:57.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:57.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:57.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:57.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:57.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:57.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:25:59.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:25:59.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:25:59.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:25:59.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:25:59.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:25:59.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:25:59.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:25:59.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:25:59.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:25:59.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:25:59.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:25:59.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:00.449 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:26:00.454 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:26:00.458 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:26:00.470 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:26:00.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:00.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:00.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:00.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:00.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:00.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:00.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:00.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:00.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:00.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:00.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:00.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:00.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:00.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:00.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:00.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:00.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:00.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:01.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:01.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c1440888f0 2023-09-23T07:26:01.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:01.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c1440ebe10 2023-09-23T07:26:01.840 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2539479216 2023-09-23T07:26:01.840 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:26:01.842 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453961 2023-09-23T07:26:01.842 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453961 -le 1695457101 ]] 2023-09-23T07:26:01.842 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2539479216 ]] 2023-09-23T07:26:01.843 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2539479216 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\8\2\9\9\4\3\0\0 ]] 2023-09-23T07:26:01.843 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/2539479216 2023-09-23T07:26:02.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:02.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:02.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:02.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:02.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:02.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:02.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:02.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:02.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:02.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:02.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:02.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:02.708 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:02.702+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:26:02.708 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:02.702+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:26:02.708 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:02.702+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:26:03.490 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.486+0000 7f9a18a5d640 -1 librbd::ImageWatcher: 0x560d133f4300 image watch failed: 94614160156672, (107) Transport endpoint is not connected 2023-09-23T07:26:03.491 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.486+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d133f4300 handle_error: handle=94614160156672: (107) Transport endpoint is not connected 2023-09-23T07:26:03.491 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.486+0000 7f9a18a5d640 -1 librbd::watcher::RewatchRequest: 0x560d12e71ef0 handle_unwatch client blocklisted 2023-09-23T07:26:03.491 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.486+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d133f4300 handle_rewatch: client blocklisted 2023-09-23T07:26:03.523 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.518+0000 7f9a18a5d640 -1 librbd::ImageWatcher: 0x560d133f4900 image watch failed: 94614164149248, (107) Transport endpoint is not connected 2023-09-23T07:26:03.523 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.518+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d133f4900 handle_error: handle=94614164149248: (107) Transport endpoint is not connected 2023-09-23T07:26:03.545 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.542+0000 7f9a18a5d640 -1 librbd::watcher::RewatchRequest: 0x560d12dc73b0 handle_unwatch client blocklisted 2023-09-23T07:26:03.545 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.542+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d133f4900 handle_rewatch: client blocklisted 2023-09-23T07:26:03.555 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.546+0000 7f9a18a5d640 -1 librbd::ImageWatcher: 0x560d133f4f00 image watch failed: 94614155567104, (107) Transport endpoint is not connected 2023-09-23T07:26:03.555 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.546+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d133f4f00 handle_error: handle=94614155567104: (107) Transport endpoint is not connected 2023-09-23T07:26:03.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:03.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:03.612 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.606+0000 7f9a18a5d640 -1 librbd::watcher::RewatchRequest: 0x560d130a3450 handle_unwatch client blocklisted 2023-09-23T07:26:03.612 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:03.606+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d133f4f00 handle_rewatch: client blocklisted 2023-09-23T07:26:03.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:03.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:03.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:03.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:03.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:03.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:03.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:03.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:03.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:03.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:03.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:03.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:04.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:04.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:04.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:04.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:04.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:04.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:04.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:04.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:04.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:04.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:04.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:04.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:04.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:04.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:04.455 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/2539479216 until 2023-09-23T08:26:03.685248+0000 (3600 sec) 2023-09-23T07:26:04.473 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:04.470+0000 7f9a18a5d640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:26:04.474 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:04.470+0000 7f9a18a5d640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x560d1316f520 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:26:04.474 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:04.470+0000 7f9a18a5d640 -1 librbd::io::AioCompletion: 0x560d13a84b00 fail: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:26:04.483 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:04.478+0000 7f9a18a5d640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:26:04.483 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:04.478+0000 7f9a18a5d640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x560d1316ea90 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:26:04.483 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:04.478+0000 7f9a18a5d640 -1 librbd::io::AioCompletion: 0x560d139f0000 fail: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:26:04.501 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:26:04.501 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/2539479216 2023-09-23T07:26:04.506 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:04.502+0000 7f9a1925e640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:26:04.506 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:04.502+0000 7f9a1925e640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x560d1316fad0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:26:04.506 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:26:04.502+0000 7f9a1925e640 -1 librbd::io::AioCompletion: 0x560d13a85ce0 fail: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:26:05.218 INFO:tasks.workunit.client.0.smithi107.stderr:listed 8 entries 2023-09-23T07:26:05.248 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/2539479216 2023-09-23T07:26:05.248 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:26:07.004 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:06.998+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:26:07.015 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:07.010+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:26:08.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:26:08.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:08.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:08.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:08.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:08.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:08.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:08.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:08.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:08.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:08.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:08.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:08.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:09.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:09.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:09.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:09.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:09.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:09.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:09.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:09.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:10.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:10.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:10.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:10.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:10.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:10.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:10.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:10.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:10.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:10.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:10.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:10.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:10.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:10.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:11.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:11.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:11.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:11.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:11.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:11.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:11.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:11.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:11.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:11.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:13.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:13.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:13.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:13.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:13.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:13.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:13.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:13.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:13.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:26:13.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:13.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:13.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:13.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:13.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:13.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:13.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:26:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:13.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:13.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:13.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:13.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:13.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:15.253 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:26:15.253 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:26:15.258 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:26:15.267 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:26:16.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2539479216 2023-09-23T07:26:16.541 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:26:16.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453976 2023-09-23T07:26:16.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453976 -le 1695457101 ]] 2023-09-23T07:26:16.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2539479216 ]] 2023-09-23T07:26:16.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2539479216 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\5\3\9\4\7\9\2\1\6 ]] 2023-09-23T07:26:16.542 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:26:18.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:18.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:18.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:18.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:18.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:18.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:18.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:18.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:18.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:18.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:18.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:18.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:18.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:18.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:20.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:20.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:20.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:20.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:20.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:20.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:20.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:20.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:20.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:20.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:20.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:20.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:20.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:20.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:20.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:20.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:20.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:20.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:20.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:21.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:21.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:21.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:21.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:21.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:21.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:21.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:21.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:21.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:21.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:21.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:21.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:21.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:21.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:21.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:21.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:21.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:21.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:21.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:21.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:21.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:21.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:21.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:23.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:23.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:23.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:23.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:23.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:23.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:23.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:23.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:23.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:23.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:23.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:23.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:23.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:23.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:23.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:23.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:23.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:23.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:23.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:23.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:23.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:23.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:24.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:24.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:24.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:24.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:24.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:24.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:24.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:24.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:24.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:24.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:24.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:24.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:24.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:24.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:24.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:24.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:24.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:24.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:25.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:25.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:25.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:25.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:26.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:26.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:26.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:26.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:26.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:26.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:26.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:26.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:26.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:26.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:26.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:26.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:26.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:26.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:26.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:26.548 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:26:26.550 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:26:26.554 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:26:26.556 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:26:26.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:26.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:26.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:26.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:26.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:26.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:26.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:26.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:27.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:26.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:28.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:28.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:28.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:28.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:28.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:28.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:28.137 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2539479216 2023-09-23T07:26:28.142 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:26:28.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453988 2023-09-23T07:26:28.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453988 -le 1695457101 ]] 2023-09-23T07:26:28.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2539479216 ]] 2023-09-23T07:26:28.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2539479216 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\5\3\9\4\7\9\2\1\6 ]] 2023-09-23T07:26:28.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:26:28.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:28.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:28.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:28.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:28.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:28.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:28.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:28.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:28.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:28.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:28.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:28.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:28.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:28.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:30.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:30.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:30.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:30.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:30.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:30.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:30.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:30.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:30.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:30.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:30.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:30.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:31.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:31.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:31.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:31.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:31.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:31.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:31.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:31.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:31.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:31.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:31.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:31.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:31.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:31.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:31.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:31.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:32.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:26:32.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:32.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:32.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:32.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:32.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:32.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:32.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:32.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:32.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:32.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:32.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:32.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:34.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:34.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:34.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:34.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:34.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:34.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:34.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:34.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:34.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:34.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:34.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:34.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:34.867 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:34.862+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:26:34.867 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:34.862+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:26:34.867 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:34.862+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:26:34.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:34.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:34.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:34.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:34.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:34.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:34.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:34.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:34.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:34.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:35.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:35.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:36.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:36.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:36.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:36.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:36.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:36.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:37.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:36.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:26:37.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:36.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:37.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:37.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:37.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:37.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:37.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:37.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:37.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:37.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:37.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:37.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:37.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:37.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:37.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:37.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:37.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:37.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:37.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:37.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:37.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:37.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:38.145 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:26:38.146 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:26:38.148 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:26:38.183 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:26:38.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:38.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:38.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:38.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:38.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:38.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:38.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:38.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:39.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:39.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:39.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:39.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:39.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:39.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:39.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:39.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:39.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:39.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:39.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:39.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:39.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:39.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:39.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:39.455 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2539479216 2023-09-23T07:26:39.455 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:26:39.455 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695453999 2023-09-23T07:26:39.456 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695453999 -le 1695457101 ]] 2023-09-23T07:26:39.456 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2539479216 ]] 2023-09-23T07:26:39.456 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2539479216 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\5\3\9\4\7\9\2\1\6 ]] 2023-09-23T07:26:39.456 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:26:40.745 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:40.742+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:26:40.745 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:40.742+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:26:41.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:41.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:41.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:41.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:41.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:41.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:41.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:41.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:41.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:41.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:41.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:41.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:41.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:41.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:41.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:41.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:41.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:41.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:41.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:41.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:41.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:41.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:41.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:41.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:41.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:41.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:41.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:41.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:41.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:41.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:41.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:41.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:41.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:41.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:41.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:26:41.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:41.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:42.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:42.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:42.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:42.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:42.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:42.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:42.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:42.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:42.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:42.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:26:42.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:42.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:42.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:42.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:42.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:42.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:42.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:42.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:42.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:42.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:42.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:42.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:26:42.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:42.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:42.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:42.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:42.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:42.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:42.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:42.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:42.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:42.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:42.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:42.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:43.398 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:43.398+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:26:43.409 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:43.410+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:26:43.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:43.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:43.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:43.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:43.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:43.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:43.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:43.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:43.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:43.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:43.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:43.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:44.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:44.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:44.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:44.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:44.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:44.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:44.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:44.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:44.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:44.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:44.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:44.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:44.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:44.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:44.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:44.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:46.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:46.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:46.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:46.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:46.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:46.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:46.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:46.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:46.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:46.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:46.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:46.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:46.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:46.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:46.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:46.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:46.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:46.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:46.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:46.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:47.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:47.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:47.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:47.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:47.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:47.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:47.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:47.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:47.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:47.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:47.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:47.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:47.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:47.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:47.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:47.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:47.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:47.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:48.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:48.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:48.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:48.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:48.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:48.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:48.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:48.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:48.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:48.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:48.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:48.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:49.468 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:26:49.469 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:26:49.471 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:26:49.476 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:26:49.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:49.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:49.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:49.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:49.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:49.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:49.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:49.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:49.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:49.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:49.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:49.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:50.417 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:50.418+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:26:50.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:50.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:50.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:50.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:50.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:50.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:50.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:50.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:50.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:50.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:50.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:50.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:50.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:50.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:50.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:50.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:50.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:50.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:50.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:50.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:50.762 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2539479216 2023-09-23T07:26:50.772 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:26:50.773 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454010 2023-09-23T07:26:50.773 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454010 -le 1695457101 ]] 2023-09-23T07:26:50.774 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2539479216 ]] 2023-09-23T07:26:50.774 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2539479216 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\5\3\9\4\7\9\2\1\6 ]] 2023-09-23T07:26:50.774 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:26:51.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:51.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:51.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:51.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:51.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:51.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:51.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:51.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:51.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:51.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:51.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:51.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:51.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:51.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:51.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:51.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:51.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:51.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:51.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:51.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:52.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:52.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:52.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:52.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:52.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:52.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:52.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:52.124 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:26:52.126+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:26:52.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:52.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:52.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:52.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:52.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:52.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:52.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:52.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:52.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:52.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:52.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:52.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:52.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:52.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:53.849 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:26:53.846+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T07:26:53.849 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:26:53.846+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:26:55.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:55.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:55.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:55.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:55.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:55.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:55.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:55.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:55.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:55.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:55.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:55.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:55.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:55.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:55.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:55.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:58.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:26:58.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:58.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:58.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:26:58.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:58.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:58.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:58.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:58.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:58.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:58.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:26:58.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:26:58.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:26:58.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:26:58.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:26:58.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:26:58.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:26:58.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:26:58.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:26:58.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:26:58.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:00.788 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:27:00.790 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:27:00.790 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:27:00.822 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:27:02.239 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/2539479216 2023-09-23T07:27:02.239 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:27:02.241 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454022 2023-09-23T07:27:02.241 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454022 -le 1695457101 ]] 2023-09-23T07:27:02.241 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/2539479216 ]] 2023-09-23T07:27:02.241 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/2539479216 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\5\3\9\4\7\9\2\1\6 ]] 2023-09-23T07:27:02.241 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:27:03.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:03.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:03.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:03.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:03.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:03.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:03.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:03.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:03.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:03.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:03.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:27:03.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:03.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:03.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:03.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:03.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:03.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:03.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:03.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:03.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:03.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:03.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:03.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:27:03.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:03.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:03.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:03.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:03.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:03.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:03.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:03.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:03.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:03.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:03.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:03.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:04.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:04.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:04.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:04.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:04.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:04.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:04.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:04.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:04.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:04.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:04.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:04.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:04.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:04.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:04.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:04.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:04.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:04.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:05.150 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:05.149+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:27:05.151 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:05.149+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:27:05.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:05.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:05.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:05.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:05.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:05.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:05.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:05.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:05.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:05.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:05.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:05.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:05.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:05.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:05.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:05.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:05.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:05.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:05.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:05.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:07.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:07.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:07.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:07.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:07.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:07.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:07.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:07.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:07.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:07.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:07.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:07.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:07.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:07.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:07.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:07.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:08.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:08.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:08.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:08.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:08.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:08.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:08.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:08.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:08.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:08.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:08.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:08.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:08.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:08.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:08.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:08.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:11.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:11.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:11.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:11.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:11.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:11.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:11.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:11.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:11.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:11.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:11.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:11.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:11.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:11.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:11.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:11.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:11.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:11.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:12.087 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:12.085+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:27:12.271 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:27:12.272 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:27:12.277 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:27:12.280 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:27:13.830 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3794664142 2023-09-23T07:27:13.830 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:27:13.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454033 2023-09-23T07:27:13.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454033 -le 1695457101 ]] 2023-09-23T07:27:13.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3794664142 ]] 2023-09-23T07:27:13.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3794664142 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\2\5\3\9\4\7\9\2\1\6 ]] 2023-09-23T07:27:13.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/3794664142 2023-09-23T07:27:16.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:27:16.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:16.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:16.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:16.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:16.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:16.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:16.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:16.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:16.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:16.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:16.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:16.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:16.540 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/3794664142 until 2023-09-23T08:27:15.920886+0000 (3600 sec) 2023-09-23T07:27:16.596 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/3794664142 2023-09-23T07:27:16.597 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:27:17.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:17.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:17.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:17.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:17.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:17.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:17.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:17.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:17.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:17.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:17.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:17.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:17.755 INFO:tasks.workunit.client.0.smithi107.stderr:listed 9 entries 2023-09-23T07:27:17.817 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/3794664142 2023-09-23T07:27:17.817 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:27:18.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:27:18.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:18.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:18.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:18.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:18.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:18.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:18.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:18.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:18.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:18.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:18.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:18.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:18.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:18.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:18.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:18.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:18.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:18.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:18.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:19.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:19.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:19.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:19.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:19.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:19.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:19.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:19.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:19.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:19.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:19.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:19.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:19.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:19.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:19.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:19.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:19.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:19.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:22.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:22.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:22.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:22.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:22.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:22.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:22.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:22.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:22.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:22.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:22.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:22.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:22.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:22.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:22.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:22.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:22.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:22.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:22.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:22.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:22.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:22.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:22.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:23.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:23.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:23.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:23.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:23.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:23.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:23.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:23.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:23.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:23.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:23.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:23.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:23.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:23.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:23.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:23.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:23.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:23.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:23.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:24.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:24.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:24.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:24.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:24.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:24.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:24.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:24.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:24.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:24.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:24.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:24.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:24.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:24.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:24.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:24.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:25.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:25.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:25.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:25.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:25.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:25.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:25.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:25.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:25.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:25.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:25.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:25.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:25.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:25.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:26.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:26.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:26.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:26.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:26.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:26.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:26.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:26.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:26.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:26.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:26.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:27:26.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:26.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:26.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:26.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:26.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:26.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:26.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:26.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:26.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:26.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:26.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:26.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:26.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:27.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:27.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:27.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:27.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:27.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:27.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:27.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:27.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:27.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:27.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:27.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:27.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:27.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:27.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:27.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:27.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:27.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:27.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:27.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:27.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:27.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:27.824 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:27:27.826 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:27:27.826 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:27:27.840 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:27:27.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:27.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:27.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:27.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:27.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:27.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:27.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:27.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:27.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:27.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:28.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:28.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:28.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:28.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:28.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:28.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:28.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:28.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:28.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:28.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:28.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:28.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:28.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:28.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:28.786 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:28.785+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:27:29.288 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3794664142 2023-09-23T07:27:29.288 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:27:29.289 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454049 2023-09-23T07:27:29.289 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454049 -le 1695457101 ]] 2023-09-23T07:27:29.289 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3794664142 ]] 2023-09-23T07:27:29.289 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3794664142 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\7\9\4\6\6\4\1\4\2 ]] 2023-09-23T07:27:29.289 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:27:33.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:27:33.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:33.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:33.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:33.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:33.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:33.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:33.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:33.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:33.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:33.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:33.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:33.761 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:27:33.761+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:27:33.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:33.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:33.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:33.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:33.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:33.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:33.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:33.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:33.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:33.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:33.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:27:33.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:33.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:33.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:33.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:33.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:34.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:34.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:34.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:34.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:34.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:34.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:34.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:34.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:34.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:34.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:34.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:34.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:34.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:34.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:34.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:34.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:36.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:36.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:36.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:36.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:36.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:36.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:36.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:36.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:36.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:36.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:36.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:36.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:36.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:36.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:36.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:36.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:36.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:36.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:37.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:37.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:37.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:37.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:37.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:37.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:37.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:37.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:37.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:37.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:37.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:37.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:37.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:37.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:37.623 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:37.617+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:27:37.623 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:37.617+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:27:37.623 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:37.617+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:27:38.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:38.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:38.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:38.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:38.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:38.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:38.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:38.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:27:38.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:38.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:38.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:38.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:38.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:38.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:38.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:38.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:38.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:27:38.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:38.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:38.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:38.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:38.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:38.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:38.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:38.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:38.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:39.315 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:27:39.316 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:27:39.328 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:27:39.334 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:27:39.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:39.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:39.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:39.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:39.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:39.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:39.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:39.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:39.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:39.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:39.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:39.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:39.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:39.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:39.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:39.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:39.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:39.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:39.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:39.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:40.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:40.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:40.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:40.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:40.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:40.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:40.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:40.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:40.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:40.907 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3794664142 2023-09-23T07:27:40.907 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:27:40.908 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454060 2023-09-23T07:27:40.908 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454060 -le 1695457101 ]] 2023-09-23T07:27:40.908 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3794664142 ]] 2023-09-23T07:27:40.908 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3794664142 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\7\9\4\6\6\4\1\4\2 ]] 2023-09-23T07:27:40.908 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:27:40.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:40.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:40.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:40.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:40.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:40.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:40.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:41.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:41.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:41.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:41.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:41.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:41.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:41.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:41.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:41.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:41.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:41.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:41.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:41.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:41.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:41.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:41.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:41.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:41.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:41.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:41.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:41.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:41.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:41.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:41.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:41.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:41.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:41.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:41.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:41.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:41.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:41.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:41.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:44.541 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:44.541+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:27:44.541 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:44.541+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:27:44.542 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:44.541+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:27:44.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:44.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:44.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:44.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:44.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:44.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:44.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:44.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:44.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:44.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:44.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:44.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:45.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:45.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:45.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:45.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:45.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:45.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:45.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:45.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:45.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:45.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:45.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:45.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:46.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:46.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:46.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:46.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:46.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:46.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:46.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:46.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:46.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:46.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:46.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:46.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:46.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:46.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:46.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:46.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:46.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:46.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:46.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:46.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:47.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:47.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:47.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:47.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:47.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:47.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:47.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:47.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:47.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:47.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:47.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:47.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:47.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:47.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:47.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:47.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:47.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:47.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:47.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:47.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:47.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:27:47.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:47.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:47.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:47.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:47.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:47.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:47.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:47.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:47.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:47.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:47.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:47.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:48.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:48.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:48.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:48.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:48.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:48.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:48.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:48.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:48.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:48.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:48.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:48.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:48.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:48.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:48.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:48.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:48.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:48.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:50.909 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:27:50.909 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:27:50.916 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:27:50.920 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:27:52.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:52.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:52.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:52.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:52.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:52.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:52.374 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3794664142 2023-09-23T07:27:52.374 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:27:52.374 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454072 2023-09-23T07:27:52.374 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454072 -le 1695457101 ]] 2023-09-23T07:27:52.374 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3794664142 ]] 2023-09-23T07:27:52.374 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3794664142 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\7\9\4\6\6\4\1\4\2 ]] 2023-09-23T07:27:52.375 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:27:52.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:52.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:52.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:52.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:52.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:52.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:52.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:52.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:52.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:52.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:52.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:52.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:52.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:52.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:52.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:52.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:52.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:52.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:52.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:52.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:52.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:52.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:52.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:52.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:52.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:52.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:52.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:52.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:52.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:52.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:52.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:52.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:52.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:52.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:52.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:52.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:52.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:53.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:53.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:53.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:27:53.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:27:53.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:53.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:53.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:53.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:53.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:53.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:53.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:53.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:53.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:53.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:56.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:56.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:27:56.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:56.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:27:56.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:56.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:27:56.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:56.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:27:56.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:56.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:27:56.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:56.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:27:56.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:56.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:27:56.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:56.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:27:56.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:27:56.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:27:57.352 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:57.349+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:27:57.352 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:57.349+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:27:57.352 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:27:57.349+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:28:00.026 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.021+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.027 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.021+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12a55500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.027 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.021+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.027 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.021+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.028 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.021+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1265e780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.028 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.021+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d12df5900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.028 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.025+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.028 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.025+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d1265fb00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.028 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.025+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.028 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.025+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d12df4180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.030 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.029+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.030 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.029+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d1304a400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.038 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.037+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.038 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.037+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12df5f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.047 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.045+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.047 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.045+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13656c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.047 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.045+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.047 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.045+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13a67000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.056 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.053+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.056 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.053+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a66e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.059 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.057+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.060 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.057+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a66900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.064 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.065+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.064 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.065+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d132e2f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.082 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.081+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.082 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.081+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a67280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.084 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.081+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.084 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.081+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a67480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.086 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.085+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.086 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.085+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a67680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.095 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.093+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.096 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.093+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a67880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.096 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.097+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.096 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.097+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a67a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.106 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.105+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.106 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.105+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a67c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.111 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.109+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.111 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.109+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a67e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.123 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.121+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:00.123 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:28:00.121+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13752080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:28:01.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:01.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:01.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:01.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:01.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:01.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:01.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:01.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:01.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:01.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:01.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:01.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:01.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:01.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:01.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:01.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:02.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:02.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:02.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:02.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:02.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:02.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:02.376 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:28:02.379 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:28:02.380 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:28:02.401 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:28:02.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:02.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:02.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:02.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:02.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:02.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:02.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:02.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:02.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:02.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:02.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:03.302 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3794664142 2023-09-23T07:28:03.302 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:28:03.303 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454083 2023-09-23T07:28:03.303 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454083 -le 1695457101 ]] 2023-09-23T07:28:03.303 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3794664142 ]] 2023-09-23T07:28:03.303 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3794664142 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\7\9\4\6\6\4\1\4\2 ]] 2023-09-23T07:28:03.303 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:28:04.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:04.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:04.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:04.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:04.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:04.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:04.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:04.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:04.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:04.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:04.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:04.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:04.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:04.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:04.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:04.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:04.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:04.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:05.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:05.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:05.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:05.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:05.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:05.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:05.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:05.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:05.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:05.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:05.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:05.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:05.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:05.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:07.082 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:07.081+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:28:07.101 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:07.093+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:28:07.101 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:07.093+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:28:07.101 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:07.093+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:28:07.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:07.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:07.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:07.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:07.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:07.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:07.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:07.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:07.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:07.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:07.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:07.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:07.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:07.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:07.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:07.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:10.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:10.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:10.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:10.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:10.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:10.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:10.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:10.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:10.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:10.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:10.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:10.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:10.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:10.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:10.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:10.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:11.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:11.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:11.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:11.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:11.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:11.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:11.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:11.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:11.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:11.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:11.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:11.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:11.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:11.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:11.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:11.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:11.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:11.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:11.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:11.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:11.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:11.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:11.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:11.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:11.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:11.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:11.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:11.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:11.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:11.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:12.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:12.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:12.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:12.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:13.306 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:28:13.309 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:28:13.312 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:28:13.314 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:28:14.634 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3794664142 2023-09-23T07:28:14.634 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:28:14.637 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454094 2023-09-23T07:28:14.637 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454094 -le 1695457101 ]] 2023-09-23T07:28:14.637 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3794664142 ]] 2023-09-23T07:28:14.637 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3794664142 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\7\9\4\6\6\4\1\4\2 ]] 2023-09-23T07:28:14.637 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:28:15.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:15.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:15.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:15.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:15.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:15.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:15.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:15.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:15.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:15.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:15.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:28:15.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:15.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:15.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:15.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:15.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:15.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:15.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:15.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:15.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:15.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:15.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:15.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:19.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:19.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:19.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:19.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:19.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:19.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:19.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:19.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:19.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:19.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:19.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:19.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:19.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:19.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:19.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:19.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:19.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:19.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:19.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:19.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:19.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:19.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:19.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:19.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:19.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:19.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:19.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:19.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:19.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:20.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:20.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:20.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:20.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:20.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:20.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:20.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:20.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:20.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:20.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:20.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:20.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:20.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:20.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:20.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:20.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:20.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:20.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:20.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:20.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:21.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:21.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:21.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:21.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:21.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:21.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:21.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:21.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:22.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:22.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:22.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:22.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:22.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:22.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:22.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:22.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:22.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:22.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:22.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:22.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:22.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:22.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:22.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:22.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:22.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:22.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:22.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:22.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:23.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:23.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:23.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:23.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:23.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:23.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:23.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:23.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:23.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:23.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:23.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:23.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:23.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:23.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:24.660 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:28:24.660 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:28:24.670 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:28:24.671 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:28:25.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:25.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:25.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:25.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:25.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:25.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:25.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:25.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:25.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:25.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:25.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:25.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:25.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:25.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:26.125 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3794664142 2023-09-23T07:28:26.126 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:28:26.126 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454106 2023-09-23T07:28:26.126 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454106 -le 1695457101 ]] 2023-09-23T07:28:26.126 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3794664142 ]] 2023-09-23T07:28:26.127 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3794664142 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\7\9\4\6\6\4\1\4\2 ]] 2023-09-23T07:28:26.127 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:28:26.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:26.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:26.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:26.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:26.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:26.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:26.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:26.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:26.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:26.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:26.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:26.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:28.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:28.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:28.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:28.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:28.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:28.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:28.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:28.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:28.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:28.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:28.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:28.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:28.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:28.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:28.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:28.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:30.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:30.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:30.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:30.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:30.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:30.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:30.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:30.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:30.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:30.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:30.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:30.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:31.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:31.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:31.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:31.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:31.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:31.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:31.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:31.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:31.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:31.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:31.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:31.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:31.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:31.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:31.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:31.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:31.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:31.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:34.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:34.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:34.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:34.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:34.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:34.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:34.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:34.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:34.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:34.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:34.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:34.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:34.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:34.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:34.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:34.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:34.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:34.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:34.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:34.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:34.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:34.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:36.130 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:28:36.130 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:28:36.131 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:28:36.154 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:28:36.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:36.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:36.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:36.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:36.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:36.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:36.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:36.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:36.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:36.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:36.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:36.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:36.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:36.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:37.666 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1403882201 2023-09-23T07:28:37.672 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:28:37.674 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454117 2023-09-23T07:28:37.674 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454117 -le 1695457101 ]] 2023-09-23T07:28:37.674 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1403882201 ]] 2023-09-23T07:28:37.674 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1403882201 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\7\9\4\6\6\4\1\4\2 ]] 2023-09-23T07:28:37.674 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/1403882201 2023-09-23T07:28:37.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:37.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:37.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:37.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:37.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:37.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:37.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:37.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:37.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:37.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:38.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:28:38.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:38.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:38.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:38.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:38.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:38.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:38.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:38.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:38.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:38.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:38.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:38.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:38.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:38.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:38.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:38.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:40.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:40.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:40.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:40.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:40.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:40.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:40.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:40.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:40.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:40.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:40.460 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/1403882201 until 2023-09-23T08:28:39.826132+0000 (3600 sec) 2023-09-23T07:28:40.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:40.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:40.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:40.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:40.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:40.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:40.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:40.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:40.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:40.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:40.527 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/1403882201 2023-09-23T07:28:40.538 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:28:41.713 INFO:tasks.workunit.client.0.smithi107.stderr:listed 10 entries 2023-09-23T07:28:41.783 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/1403882201 2023-09-23T07:28:41.783 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:28:41.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:41.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:41.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:41.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:41.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:41.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:41.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:41.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:41.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:41.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:41.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:41.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:41.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:41.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:41.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:41.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:41.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:41.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:41.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:41.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:45.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:45.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:45.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:45.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:45.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:45.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:45.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:28:45.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:45.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:45.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:45.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:45.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:45.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:45.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:45.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:45.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:45.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:45.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:45.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:45.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:45.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:45.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:45.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:28:45.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:45.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:45.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:46.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:46.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:46.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:46.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:46.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:46.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:46.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:46.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:46.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:46.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:46.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:46.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:46.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:46.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:46.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:46.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:46.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:48.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:48.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:48.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:48.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:48.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:48.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:48.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:48.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:48.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:48.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:48.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:48.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:48.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:48.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:48.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:48.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:48.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:49.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:49.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:49.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:49.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:49.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:49.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:49.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:49.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:49.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:49.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:49.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:49.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:49.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:49.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:49.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:49.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:50.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:50.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:50.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:50.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:50.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:50.365 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:50.364+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:28:50.365 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:50.364+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:28:50.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:50.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:50.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:50.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:50.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:50.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:50.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:50.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:50.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:51.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:51.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:51.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:51.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:51.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:51.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:51.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:51.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:51.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:51.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:51.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:51.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:51.786 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:28:51.786 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:28:51.794 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:28:51.798 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:28:53.246 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1403882201 2023-09-23T07:28:53.246 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:28:53.247 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454133 2023-09-23T07:28:53.247 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454133 -le 1695457101 ]] 2023-09-23T07:28:53.247 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1403882201 ]] 2023-09-23T07:28:53.247 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1403882201 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\4\0\3\8\8\2\2\0\1 ]] 2023-09-23T07:28:53.247 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:28:54.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:54.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:54.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:54.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:54.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:54.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:54.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:54.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:54.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:54.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:54.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:54.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:54.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:54.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:54.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:54.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:54.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:54.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:55.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:55.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:55.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:55.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:55.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:55.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:55.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:55.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:55.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:55.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:55.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:55.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:55.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:55.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:55.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:55.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:55.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:55.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:55.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:56.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:56.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:56.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:56.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:56.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:56.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:56.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:56.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:56.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:56.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:56.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:56.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:58.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:58.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:58.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:58.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:58.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:58.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:58.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:58.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:58.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:28:58.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:58.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:58.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:58.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:58.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:58.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:58.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:58.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:58.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:58.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:58.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:58.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:59.198 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:59.196+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:28:59.198 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:59.196+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:28:59.204 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:59.204+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:28:59.204 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:59.204+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:28:59.204 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:28:59.204+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:28:59.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:59.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:59.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:28:59.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:28:59.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:28:59.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:28:59.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:28:59.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:28:59.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:28:59.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:28:59.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:28:59.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:28:59.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:28:59.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:28:59.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:28:59.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:00.009 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.008+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.009 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.008+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.010 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.008+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13656080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.010 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.008+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288b180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:00.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:00.019 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.016+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.019 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.016+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13752f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.023 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.020+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.023 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.020+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13753800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:00.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:00.030 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.028+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.030 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.028+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13753600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.030 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.028+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.030 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.028+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13753400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:00.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:00.071 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.068+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.071 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.068+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13753d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.071 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.068+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.071 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.068+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13753b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:00.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:00.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:00.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:00.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:00.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:00.090 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.088+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.090 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.088+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13753200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:00.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:00.093 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.092+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.093 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.092+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13753f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.108 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.104+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.108 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.104+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139ca100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.137 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.136+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.137 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.136+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.137 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.136+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.137 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.136+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.137 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.136+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139ca300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.137 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.136+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139ca500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.137 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.136+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139ca700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.137 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.136+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139ca900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.146 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.144+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.146 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.144+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139cab00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.146 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.144+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.147 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.144+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139cad00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.169 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.168+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.169 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.168+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139caf00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.169 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.168+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.170 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.168+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.170 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.168+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139cb100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:00.170 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:29:00.168+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139ca100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:29:01.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:01.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:01.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:01.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:01.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:01.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:01.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:01.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:01.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:01.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:01.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:01.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:02.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:02.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:02.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:02.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:02.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:02.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:02.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:02.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:02.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:02.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:29:02.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:02.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:02.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:02.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:02.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:02.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:02.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:02.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:02.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:02.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:02.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:02.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:02.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:02.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:02.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:02.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:02.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:02.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:02.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:02.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:02.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:02.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:02.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:02.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:02.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:02.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:02.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:02.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:02.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:02.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:02.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:02.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:02.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:29:02.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:02.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:02.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:02.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:02.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:02.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:03.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:03.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:03.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:03.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:03.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:03.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:03.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:29:03.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:03.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:03.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:03.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:03.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:03.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:03.249 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:29:03.249 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:29:03.251 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:29:03.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:03.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:03.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:03.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:03.269 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:29:03.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:03.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:03.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:03.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:03.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:03.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:03.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:03.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:03.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:03.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:03.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:03.996 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:03.996+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:29:03.996 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:03.996+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:29:04.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:04.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:04.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:04.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:04.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:04.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:04.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:04.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:04.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:04.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:04.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:04.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:04.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:04.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:04.698 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1403882201 2023-09-23T07:29:04.698 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:29:04.698 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454144 2023-09-23T07:29:04.699 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454144 -le 1695457101 ]] 2023-09-23T07:29:04.699 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1403882201 ]] 2023-09-23T07:29:04.699 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1403882201 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\4\0\3\8\8\2\2\0\1 ]] 2023-09-23T07:29:04.699 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:29:04.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:04.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:04.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:04.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:05.386 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:05.384+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:29:06.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:06.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:06.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:06.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:06.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:06.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:06.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:06.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:29:06.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:06.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:06.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:06.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:06.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:06.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:06.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:06.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:06.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:07.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:07.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:07.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:07.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:07.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:07.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:07.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:07.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:07.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:29:07.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:07.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:07.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:07.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:07.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:07.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:09.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:09.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:09.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:09.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:09.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:09.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:09.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:09.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:09.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:09.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:09.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:09.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:09.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:09.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:10.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:10.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:10.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:10.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:10.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:10.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:10.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:10.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:10.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:10.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:10.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:10.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:11.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:11.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:11.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:11.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:11.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:11.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:11.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:11.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:11.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:11.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:11.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:11.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:11.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:11.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:11.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:11.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:11.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:11.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:11.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:11.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:11.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:11.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:12.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:12.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:12.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:12.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:12.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:12.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:12.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:12.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:12.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:12.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:12.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:12.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:13.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:13.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:13.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:13.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:13.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:13.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:13.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:13.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:13.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:13.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:13.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:13.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:13.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:13.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:13.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:13.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:13.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:13.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:13.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:13.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:14.701 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:29:14.701 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:29:14.701 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:29:14.701 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:29:14.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:14.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:29:14.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:14.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:15.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:15.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:15.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:15.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:15.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:15.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:15.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:15.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:15.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:15.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:15.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:15.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:15.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:15.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:15.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:15.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:15.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:15.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:15.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:15.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:15.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:15.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:15.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:15.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:15.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:15.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:15.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:15.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:15.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:16.138 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1403882201 2023-09-23T07:29:16.138 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:29:16.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454156 2023-09-23T07:29:16.144 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454156 -le 1695457101 ]] 2023-09-23T07:29:16.144 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1403882201 ]] 2023-09-23T07:29:16.144 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1403882201 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\4\0\3\8\8\2\2\0\1 ]] 2023-09-23T07:29:16.144 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:29:19.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:19.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:19.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:19.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:19.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:19.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:19.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:19.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:19.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:19.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:19.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:19.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:19.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:19.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:19.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:19.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:19.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:19.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:19.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:19.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:19.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:20.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:20.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:20.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:20.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:20.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:20.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:20.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:20.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:20.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:20.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:20.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:20.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:21.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:21.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:21.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:21.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:21.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:21.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:21.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:21.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:21.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:21.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:21.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:21.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:21.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:21.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:21.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:21.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:21.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:21.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:21.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:21.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:21.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:21.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:21.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:22.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:22.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:22.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:22.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:22.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:22.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:22.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:22.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:22.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:22.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:22.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:22.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:22.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:22.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:22.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:22.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:23.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:23.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:23.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:23.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:23.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:23.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:23.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:23.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:23.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:23.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:23.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:23.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:23.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:23.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:23.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:23.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:23.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:23.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:24.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:24.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:24.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:24.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:24.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:24.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:24.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:24.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:24.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:24.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:24.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:24.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:24.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:24.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:24.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:24.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:24.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:24.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:24.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:24.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:26.154 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:29:26.173 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:29:26.174 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:29:26.181 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:29:26.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:26.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:26.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:26.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:26.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:26.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:26.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:26.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:26.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:26.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:26.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:26.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:26.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:26.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:26.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:26.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:26.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:26.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:27.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:27.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:27.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:27.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:27.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:27.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:27.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:27.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:27.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:27.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:27.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:27.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:27.605 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1403882201 2023-09-23T07:29:27.606 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:29:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454167 2023-09-23T07:29:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454167 -le 1695457101 ]] 2023-09-23T07:29:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1403882201 ]] 2023-09-23T07:29:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1403882201 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\4\0\3\8\8\2\2\0\1 ]] 2023-09-23T07:29:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:29:28.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:28.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:28.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:28.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:28.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:28.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:28.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:28.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:28.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:28.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:28.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:28.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:28.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:28.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:28.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:28.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:28.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:28.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:28.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:29.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:29.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:29.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:29.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:29.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:29.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:29.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:29.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:29.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:29.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:29.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:29.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:31.376 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:31.368+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:29:31.377 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:31.368+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:29:31.385 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:31.384+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:29:31.385 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:31.384+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:29:31.385 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:31.384+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:29:31.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:31.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:31.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:31.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:31.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:31.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:31.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:31.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:32.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:32.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:32.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:32.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:32.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:32.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:32.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:32.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:32.089 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:32.088+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:29:32.089 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:32.088+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:29:33.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:33.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:33.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:33.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:33.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:33.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:33.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:33.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:33.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:33.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:33.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:33.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:33.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:33.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:33.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:33.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:33.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:33.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:34.958 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:34.956+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:29:34.959 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:34.956+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:29:37.608 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:29:37.608 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:29:37.608 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:29:37.628 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:29:38.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:38.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:38.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:38.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:38.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:38.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:38.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:38.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:38.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:38.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:38.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:38.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:39.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:39.220 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1403882201 2023-09-23T07:29:39.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:39.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:39.231 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:29:39.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454179 2023-09-23T07:29:39.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454179 -le 1695457101 ]] 2023-09-23T07:29:39.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1403882201 ]] 2023-09-23T07:29:39.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1403882201 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\4\0\3\8\8\2\2\0\1 ]] 2023-09-23T07:29:39.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:29:39.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:39.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:39.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:39.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:39.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:39.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:29:39.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:39.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:39.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:39.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:39.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:39.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:39.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:39.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:39.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:40.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:40.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:40.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:40.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:40.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:40.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:40.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:40.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:40.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:40.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:40.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:40.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:41.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:41.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:41.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:41.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:41.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:41.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:41.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:41.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:43.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:43.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:43.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:43.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:43.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:43.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:43.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:43.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:43.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:43.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:43.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:43.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:43.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:43.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:43.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:43.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:43.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:43.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:44.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:44.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:44.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:44.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:44.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:44.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:44.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:44.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:44.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:44.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:44.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:44.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:44.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:44.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:44.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:44.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:44.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:44.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:44.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:44.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:45.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:45.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:45.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:45.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:45.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:45.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:45.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:45.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:45.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:45.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:45.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:45.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:45.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:45.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:45.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:45.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:45.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:45.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:45.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:45.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:45.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:45.804 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:45.795+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:29:45.812 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:45.811+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:29:45.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:45.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:45.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:45.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:46.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:46.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:46.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:46.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:46.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:46.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:46.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:46.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:46.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:46.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:46.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:46.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:46.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:46.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:46.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:47.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:47.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:47.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:47.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:47.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:47.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:47.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:47.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:47.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:47.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:47.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:47.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:47.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:47.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:47.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:47.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:47.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:47.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:48.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:48.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:48.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:48.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:48.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:48.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:48.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:48.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:48.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:48.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:48.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:48.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:48.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:48.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:48.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:48.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:49.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:29:49.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:49.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:49.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:49.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:49.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:49.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:49.281 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:29:49.285 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:29:49.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:49.297 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:29:49.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:49.305 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:29:49.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:49.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:49.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:50.609 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/4281073538 2023-09-23T07:29:50.610 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:29:50.612 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454190 2023-09-23T07:29:50.613 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454190 -le 1695457101 ]] 2023-09-23T07:29:50.613 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/4281073538 ]] 2023-09-23T07:29:50.613 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/4281073538 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\4\0\3\8\8\2\2\0\1 ]] 2023-09-23T07:29:50.613 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/4281073538 2023-09-23T07:29:50.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:50.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:50.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:50.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:50.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:50.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:50.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:50.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:50.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:50.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:50.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:50.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:51.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:29:51.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:51.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:51.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:51.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:51.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:51.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:51.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:51.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:51.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:51.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:51.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:51.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:52.485 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/4281073538 until 2023-09-23T08:29:51.703157+0000 (3600 sec) 2023-09-23T07:29:52.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:52.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:52.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/4281073538 2023-09-23T07:29:52.534 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:29:52.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:52.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:52.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:52.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:52.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:52.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:52.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:52.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:52.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:52.762 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:52.759+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:29:52.762 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:52.759+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:29:53.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:53.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:53.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:53.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:53.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:53.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:53.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:53.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:53.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:53.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:53.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:29:53.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:53.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:53.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:53.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:53.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:53.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:53.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:53.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:53.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:53.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:53.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:53.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:53.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:53.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:53.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:53.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:53.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:53.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:53.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:53.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:53.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:53.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:53.802 INFO:tasks.workunit.client.0.smithi107.stderr:listed 11 entries 2023-09-23T07:29:53.841 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/4281073538 2023-09-23T07:29:53.841 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:29:55.089 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:29:55.087+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:29:55.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:29:55.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:55.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:55.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:55.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:55.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:55.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:55.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:55.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:55.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:55.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:58.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:58.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:29:58.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:58.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:58.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:58.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:29:58.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:58.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:58.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:58.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:58.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:58.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:29:59.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:59.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:29:59.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:59.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:29:59.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:59.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:29:59.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:59.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:29:59.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:59.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:29:59.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:59.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:29:59.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:59.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:29:59.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:29:59.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:00.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:00.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:00.074 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.071+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.071+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.071+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.071+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.071+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.071+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12df4280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.071+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1365c480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.071+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288b180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.071+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1365d700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.075 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.071+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288a480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.089 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.087+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.089 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.087+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a66f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.090 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.087+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.090 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.087+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.090 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.087+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a66580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.090 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.087+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a66180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.090 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.087+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.090 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.087+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.091 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.087+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12aadf00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.091 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.087+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12aac000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:00.108 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.107+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.108 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.107+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12df4180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:00.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:00.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:00.143 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.139+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.143 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.139+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d1365c480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:00.148 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.147+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.148 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.147+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.148 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.147+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288b180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.148 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.147+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d1365d700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.155+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.159 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.155+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.160 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.155+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.160 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.155+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.160 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.155+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d1288a480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.160 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.155+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a66f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.160 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.155+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a66580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.160 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.155+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13a66180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:00.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:00.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:00.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:00.187 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.183+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.187 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.187+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12aadf00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.200 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.199+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.201 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:30:00.199+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d12aac000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:30:00.496 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:00.495+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:30:00.520 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:00.515+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:30:00.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:00.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:00.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:01.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:01.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:01.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:01.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:01.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:01.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:01.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:01.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:01.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:30:01.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:01.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:01.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:01.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:01.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:01.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:01.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:01.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:01.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:01.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:01.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:01.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:02.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:02.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:02.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:02.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:02.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:02.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:02.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:02.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:02.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:02.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:02.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:02.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:03.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:03.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:03.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:03.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:03.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:03.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:03.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:03.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:03.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:03.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:03.594 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:03.591+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:30:03.594 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:03.591+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:30:03.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:03.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:03.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:03.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:03.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:03.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:03.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:03.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:03.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:03.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:03.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:03.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:03.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:03.848 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:30:03.849 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:30:03.853 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:30:03.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:03.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:03.863 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:30:03.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:03.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:03.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:03.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:03.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:03.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:03.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:04.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:04.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:04.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:04.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:04.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:04.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:04.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:04.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:04.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:04.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:04.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:04.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:05.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:05.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:05.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:05.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:05.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:05.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:05.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:05.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:05.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:05.420 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/4281073538 2023-09-23T07:30:05.421 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:30:05.423 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454205 2023-09-23T07:30:05.423 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454205 -le 1695457101 ]] 2023-09-23T07:30:05.423 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/4281073538 ]] 2023-09-23T07:30:05.424 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/4281073538 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\4\2\8\1\0\7\3\5\3\8 ]] 2023-09-23T07:30:05.424 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:30:05.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:05.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:05.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:05.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:05.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:05.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:05.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:05.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:05.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:05.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:30:05.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:05.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:05.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:05.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:05.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:05.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:05.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:05.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:05.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:05.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:05.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:05.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:06.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:06.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:06.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:06.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:06.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:06.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:06.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:06.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:06.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:06.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:06.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:06.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:07.321 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:07.319+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:30:07.329 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:07.327+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:30:07.330 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:07.327+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:30:07.330 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:07.327+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:30:07.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:07.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:07.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:07.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:07.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:07.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:07.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:07.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:07.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:07.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:07.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:07.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:07.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:07.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:07.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:07.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:07.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:07.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:07.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:07.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:13.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:13.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:13.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:13.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:13.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:13.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:13.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:13.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:13.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:13.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:13.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:13.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:13.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:13.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:13.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:13.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:13.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:13.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:13.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:13.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:13.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:13.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:13.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:14.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:14.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:14.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:14.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:14.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:14.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:14.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:14.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:14.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:14.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:14.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:14.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:14.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:14.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:14.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:14.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:14.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:14.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:15.432 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:30:15.433 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:30:15.433 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:30:15.464 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:30:16.824 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/4281073538 2023-09-23T07:30:16.824 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:30:16.825 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454216 2023-09-23T07:30:16.825 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454216 -le 1695457101 ]] 2023-09-23T07:30:16.825 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/4281073538 ]] 2023-09-23T07:30:16.825 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/4281073538 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\4\2\8\1\0\7\3\5\3\8 ]] 2023-09-23T07:30:16.825 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:30:17.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:17.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:17.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:17.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:17.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:17.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:17.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:17.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:17.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:17.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:17.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:17.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:17.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:17.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:17.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:17.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:17.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:17.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:17.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:17.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:19.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:19.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:19.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:19.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:19.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:19.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:19.491 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:19.487+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:30:19.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:19.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:19.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:19.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:19.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:19.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:20.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:20.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:20.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:20.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:20.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:20.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:20.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:20.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:20.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:20.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:20.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:20.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:21.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:21.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:21.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:21.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:21.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:21.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:21.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:21.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:21.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:21.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:21.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:21.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:21.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:21.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:21.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:21.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:21.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:21.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:21.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:22.005 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:30:22.003+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:30:22.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:22.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:22.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:22.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:22.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:22.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:22.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:22.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:22.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:22.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:22.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:22.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:22.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:22.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:22.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:22.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:22.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:22.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:25.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:30:25.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:25.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:25.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:25.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:25.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:25.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:25.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:25.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:25.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:25.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:25.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:25.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:25.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:25.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:25.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:25.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:25.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:25.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:25.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:25.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:25.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:26.095 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:26.083+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:30:26.095 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:26.083+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:30:26.095 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:26.083+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:30:26.827 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:30:26.828 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:30:26.841 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:30:26.845 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:30:27.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:30:27.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:27.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:27.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:27.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:27.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:27.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:27.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:27.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:27.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:27.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:27.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:27.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:30:27.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:27.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:27.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:27.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:27.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:27.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:27.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:27.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:27.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:27.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:27.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:27.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:28.222 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/4281073538 2023-09-23T07:30:28.222 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:30:28.223 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454228 2023-09-23T07:30:28.223 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454228 -le 1695457101 ]] 2023-09-23T07:30:28.223 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/4281073538 ]] 2023-09-23T07:30:28.223 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/4281073538 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\4\2\8\1\0\7\3\5\3\8 ]] 2023-09-23T07:30:28.224 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:30:28.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:28.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:28.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:28.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:28.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:28.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:28.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:28.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:28.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:28.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:28.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:28.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:28.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:28.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:28.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:28.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:29.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:29.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:29.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:29.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:29.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:29.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:29.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:29.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:29.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:29.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:29.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:29.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:29.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:29.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:29.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:29.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:29.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:29.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:29.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:29.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:29.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:29.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:29.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:29.864 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:29.863+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:30:29.864 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:29.863+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:30:30.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:30.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:30.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:30.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:30.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:30.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:30.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:30.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:30.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:30.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:30.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:30.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:31.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:31.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:31.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:31.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:31.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:31.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:31.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:31.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:31.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:31.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:31.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:31.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:31.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:31.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:31.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:31.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:31.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:31.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:32.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:32.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:32.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:32.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:32.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:32.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:32.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:32.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:32.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:32.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:32.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:32.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:32.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:32.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:32.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:32.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:33.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:33.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:33.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:33.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:33.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:33.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:33.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:33.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:33.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:33.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:33.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:33.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:34.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:34.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:34.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:34.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:34.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:34.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:34.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:34.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:34.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:34.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:34.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:34.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:34.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:34.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:34.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:34.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:34.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:34.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:34.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:34.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:35.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:35.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:35.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:35.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:35.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:35.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:35.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:35.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:35.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:35.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:35.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:35.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:35.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:35.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:37.905 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:37.903+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:30:37.905 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:37.903+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:30:37.905 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:37.903+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:30:38.277 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:30:38.277 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:30:38.278 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:30:38.279 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:30:38.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:38.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:38.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:38.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:38.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:38.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:38.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:38.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:38.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:38.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:38.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:38.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:38.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:38.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:38.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:38.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:39.780 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/4281073538 2023-09-23T07:30:39.785 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:30:39.787 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454239 2023-09-23T07:30:39.787 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454239 -le 1695457101 ]] 2023-09-23T07:30:39.787 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/4281073538 ]] 2023-09-23T07:30:39.787 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/4281073538 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\4\2\8\1\0\7\3\5\3\8 ]] 2023-09-23T07:30:39.787 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:30:41.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:41.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:41.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:41.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:41.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:41.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:30:41.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:41.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:41.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:41.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:41.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:41.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:41.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:41.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:41.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:41.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:41.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:41.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:41.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:41.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:41.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:41.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:41.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:41.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:41.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:41.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:43.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:43.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:43.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:43.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:43.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:43.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:43.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:43.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:43.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:43.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:43.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:43.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:43.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:43.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:43.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:43.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:43.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:43.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:45.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:45.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:45.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:45.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:45.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:45.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:45.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:45.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:45.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:45.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:45.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:45.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:45.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:45.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:45.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:45.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:46.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:46.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:46.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:46.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:46.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:46.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:46.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:46.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:46.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:46.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:46.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:46.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:46.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:46.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:46.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:46.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:46.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:46.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:46.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:46.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:47.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:47.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:47.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:47.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:47.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:47.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:48.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:48.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:48.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:48.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:48.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:48.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:48.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:48.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:48.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:48.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:48.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:48.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:48.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:48.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:48.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:49.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:30:49.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:49.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:49.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:49.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:49.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:49.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:49.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:49.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:49.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:49.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:49.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:49.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:49.799 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:30:49.801 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:30:49.823 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:30:49.871 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:30:50.980 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:50.979+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:30:50.980 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:50.979+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:30:50.988 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:50.987+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:30:50.988 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:50.987+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:30:50.988 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:50.987+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:30:51.138 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/4281073538 2023-09-23T07:30:51.144 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:30:51.145 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454251 2023-09-23T07:30:51.145 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454251 -le 1695457101 ]] 2023-09-23T07:30:51.145 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/4281073538 ]] 2023-09-23T07:30:51.146 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/4281073538 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\4\2\8\1\0\7\3\5\3\8 ]] 2023-09-23T07:30:51.146 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:30:51.696 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:51.691+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:30:51.696 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:51.691+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:30:51.696 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:51.691+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:30:52.391 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:52.387+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:30:52.392 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:52.387+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:30:52.392 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:52.387+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:30:53.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:53.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:53.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:53.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:53.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:53.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:53.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:53.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:53.749 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:53.747+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:30:53.749 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:53.747+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:30:53.749 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:53.747+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:30:53.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:53.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:53.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:53.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:53.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:53.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:53.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:53.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:53.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:53.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:55.347 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:55.335+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:30:55.348 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:55.335+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:30:55.348 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:30:55.335+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:30:55.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:55.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:30:55.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:55.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:55.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:55.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:55.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:55.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:55.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:55.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:55.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:55.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:55.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:55.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:55.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:55.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:56.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:56.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:56.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:56.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:56.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:56.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:56.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:56.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:56.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:56.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:56.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:56.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:56.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:56.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:30:57.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:57.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:30:57.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:57.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:30:57.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:57.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:30:57.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:57.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:30:57.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:57.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:30:57.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:57.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:30:57.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:57.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:30:57.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:57.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:30:57.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:57.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:30:57.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:30:57.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:00.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:00.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c15e9c2f70 2023-09-23T07:31:00.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:00.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c15e9c3110 2023-09-23T07:31:00.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:00.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c16132f040 2023-09-23T07:31:00.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:00.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c16132fba0 2023-09-23T07:31:00.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:00.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c163845520 2023-09-23T07:31:01.151 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:31:01.151 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:31:01.151 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:31:01.151 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:31:01.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:01.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:01.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:01.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:01.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:01.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:01.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:01.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:01.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:01.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:01.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:01.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:01.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:01.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:01.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:01.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:01.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:01.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:01.648 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:31:01.647+0000 7f3edd275640 -1 reset not still connected to 0x55a203bccea0 2023-09-23T07:31:02.585 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3331528018 2023-09-23T07:31:02.585 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:31:02.586 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454262 2023-09-23T07:31:02.586 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454262 -le 1695457101 ]] 2023-09-23T07:31:02.586 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3331528018 ]] 2023-09-23T07:31:02.586 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3331528018 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\4\2\8\1\0\7\3\5\3\8 ]] 2023-09-23T07:31:02.586 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/3331528018 2023-09-23T07:31:02.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:02.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:02.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:02.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:02.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:02.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:03.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:03.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:03.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:03.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:03.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:03.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:03.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:03.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:03.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:03.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:03.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:03.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:03.421 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.419+0000 7f9a18a5d640 -1 librbd::ImageWatcher: 0x560d12f81500 image watch failed: 94614165917696, (107) Transport endpoint is not connected 2023-09-23T07:31:03.421 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.419+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d12f81500 handle_error: handle=94614165917696: (107) Transport endpoint is not connected 2023-09-23T07:31:03.421 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.419+0000 7f9a18a5d640 -1 librbd::watcher::RewatchRequest: 0x560d12edfa90 handle_unwatch client blocklisted 2023-09-23T07:31:03.422 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.419+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d12f81500 handle_rewatch: client blocklisted 2023-09-23T07:31:03.430 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.427+0000 7f9a18a5d640 -1 librbd::ImageWatcher: 0x560d12d74300 image watch failed: 94614165878784, (107) Transport endpoint is not connected 2023-09-23T07:31:03.431 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.427+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d12d74300 handle_error: handle=94614165878784: (107) Transport endpoint is not connected 2023-09-23T07:31:03.431 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.427+0000 7f9a18a5d640 -1 librbd::watcher::RewatchRequest: 0x560d12fb3a40 handle_unwatch client blocklisted 2023-09-23T07:31:03.431 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.427+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d12d74300 handle_rewatch: client blocklisted 2023-09-23T07:31:03.439 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.435+0000 7f9a18a5d640 -1 librbd::ImageWatcher: 0x560d12f81b00 image watch failed: 94614165939200, (107) Transport endpoint is not connected 2023-09-23T07:31:03.439 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.435+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d12f81b00 handle_error: handle=94614165939200: (107) Transport endpoint is not connected 2023-09-23T07:31:03.439 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.435+0000 7f9a18a5d640 -1 librbd::watcher::RewatchRequest: 0x560d12b17770 handle_unwatch client blocklisted 2023-09-23T07:31:03.440 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.435+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d12f81b00 handle_rewatch: client blocklisted 2023-09-23T07:31:03.494 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.491+0000 7f9a18a5d640 -1 librbd::ImageWatcher: 0x560d1349e900 image watch failed: 94614165874688, (107) Transport endpoint is not connected 2023-09-23T07:31:03.494 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.491+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d1349e900 handle_error: handle=94614165874688: (107) Transport endpoint is not connected 2023-09-23T07:31:03.495 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.491+0000 7f9a1925e640 -1 librbd::watcher::RewatchRequest: 0x560d12ea11d0 handle_unwatch client blocklisted 2023-09-23T07:31:03.495 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.491+0000 7f9a1925e640 -1 librbd::Watcher: 0x560d1349e900 handle_rewatch: client blocklisted 2023-09-23T07:31:03.496 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.495+0000 7f9a18a5d640 -1 librbd::ImageWatcher: 0x560d12d75b00 image watch failed: 94614165920768, (107) Transport endpoint is not connected 2023-09-23T07:31:03.496 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.495+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d12d75b00 handle_error: handle=94614165920768: (107) Transport endpoint is not connected 2023-09-23T07:31:03.501 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.499+0000 7f9a18a5d640 -1 librbd::watcher::RewatchRequest: 0x560d133f2550 handle_unwatch client blocklisted 2023-09-23T07:31:03.502 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.499+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d12d75b00 handle_rewatch: client blocklisted 2023-09-23T07:31:03.511 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.507+0000 7f9a18a5d640 -1 librbd::ImageWatcher: 0x560d1349fb00 image watch failed: 94614165838848, (107) Transport endpoint is not connected 2023-09-23T07:31:03.511 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.507+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d1349fb00 handle_error: handle=94614165838848: (107) Transport endpoint is not connected 2023-09-23T07:31:03.511 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.507+0000 7f9a1925e640 -1 librbd::ImageWatcher: 0x560d1349e600 image watch failed: 94614165836800, (107) Transport endpoint is not connected 2023-09-23T07:31:03.511 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.507+0000 7f9a1925e640 -1 librbd::Watcher: 0x560d1349e600 handle_error: handle=94614165836800: (107) Transport endpoint is not connected 2023-09-23T07:31:03.591 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.591+0000 7f9a18a5d640 -1 librbd::watcher::RewatchRequest: 0x560d12fb22d0 handle_unwatch client blocklisted 2023-09-23T07:31:03.592 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.591+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d1349fb00 handle_rewatch: client blocklisted 2023-09-23T07:31:03.592 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.591+0000 7f9a18a5d640 -1 librbd::watcher::RewatchRequest: 0x560d12edff40 handle_unwatch client blocklisted 2023-09-23T07:31:03.592 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:03.591+0000 7f9a18a5d640 -1 librbd::Watcher: 0x560d1349e600 handle_rewatch: client blocklisted 2023-09-23T07:31:04.390 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/3331528018 until 2023-09-23T08:31:03.588910+0000 (3600 sec) 2023-09-23T07:31:04.423 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.419+0000 7f9a18a5d640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.423 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.419+0000 7f9a18a5d640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x560d1316e340 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.424 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.419+0000 7f9a18a5d640 -1 librbd::io::AioCompletion: 0x560d13b43760 fail: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.424 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.423+0000 7f9a1925e640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.424 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.423+0000 7f9a1925e640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x560d1316e1a0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.424 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.423+0000 7f9a1925e640 -1 librbd::io::AioCompletion: 0x560d13bef760 fail: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.425 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:31:04.425 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/3331528018 2023-09-23T07:31:04.435 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.431+0000 7f9a1925e640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.436 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.431+0000 7f9a1925e640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.436 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.431+0000 7f9a1925e640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.436 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.431+0000 7f9a1925e640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x560d1316f040 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.436 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.431+0000 7f9a1925e640 -1 librbd::io::AioCompletion: 0x560d13ba8160 fail: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.436 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.431+0000 7f9a1925e640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x560d1316ec30 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.436 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.431+0000 7f9a1925e640 -1 librbd::io::AioCompletion: 0x560d13ba8c60 fail: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.436 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.431+0000 7f9a1925e640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x560d1316e410 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.436 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.431+0000 7f9a1925e640 -1 librbd::io::AioCompletion: 0x560d13ba8f20 fail: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.447 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.443+0000 7f9a18a5d640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.447 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.443+0000 7f9a18a5d640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x560d1316ed00 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.447 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.443+0000 7f9a18a5d640 -1 librbd::io::AioCompletion: 0x560d13ba86e0 fail: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.473 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.471+0000 7f9a18a5d640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.473 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.471+0000 7f9a18a5d640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x560d1316eea0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.473 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:31:04.471+0000 7f9a18a5d640 -1 librbd::io::AioCompletion: 0x560d13ba9080 fail: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:31:04.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:04.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:04.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:04.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:04.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:04.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:04.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:04.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:04.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:04.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:04.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:04.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:04.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:04.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:04.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:04.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:04.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:04.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:05.273 INFO:tasks.workunit.client.0.smithi107.stderr:listed 12 entries 2023-09-23T07:31:05.327 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/3331528018 2023-09-23T07:31:05.327 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:31:05.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:05.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:05.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:05.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:05.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:05.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:05.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:05.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:06.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:06.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:06.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:06.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:06.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:06.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:06.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:06.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:06.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:06.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:06.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:06.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:06.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:06.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:06.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:06.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:06.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:06.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:07.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:07.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:07.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:07.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:07.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:07.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:07.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:07.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:07.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:07.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:07.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:07.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:07.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:07.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:07.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:07.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:07.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:07.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:07.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:07.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:07.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:07.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:07.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:07.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:07.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:11.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:11.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:11.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:11.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:11.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:11.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:11.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:11.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:11.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:11.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:11.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:11.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:11.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:11.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:15.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:15.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:15.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:15.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:15.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:15.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:15.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:15.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:15.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:15.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:15.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:15.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:15.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:15.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:15.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:15.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:15.340 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:31:15.342 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:31:15.348 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:31:15.362 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:31:16.580 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3331528018 2023-09-23T07:31:16.582 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:31:16.583 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454276 2023-09-23T07:31:16.583 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454276 -le 1695457101 ]] 2023-09-23T07:31:16.583 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3331528018 ]] 2023-09-23T07:31:16.583 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3331528018 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\3\3\1\5\2\8\0\1\8 ]] 2023-09-23T07:31:16.583 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:31:18.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:31:18.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:18.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:18.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:18.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:18.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:18.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:18.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:18.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:18.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:18.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:18.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:18.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:19.191 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:31:19.182+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:31:19.191 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:31:19.182+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:31:19.191 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:31:19.182+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:31:19.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:19.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:19.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:19.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:19.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:19.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:19.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:19.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:19.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:19.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:19.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:19.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:19.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:19.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:19.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:19.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:22.922 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:31:22.918+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:31:22.923 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:31:22.918+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:31:22.923 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:31:22.918+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:31:23.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:23.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:23.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:23.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:23.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:23.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:23.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:23.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:23.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:23.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:23.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:23.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:23.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:23.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:23.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:23.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:23.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:23.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:24.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:24.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:24.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:24.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:24.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:24.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:24.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:24.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:24.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:24.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:24.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:24.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:24.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:24.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:25.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:25.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:25.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:25.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:25.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:25.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:25.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:25.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:25.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:25.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:25.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:25.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:25.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:25.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:25.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:25.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:25.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:25.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:25.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:25.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:25.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:25.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:25.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:25.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:25.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:25.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:25.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:25.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:25.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:25.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:25.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:26.595 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:31:26.601 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:31:26.602 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:31:26.602 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:31:28.236 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3331528018 2023-09-23T07:31:28.244 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:31:28.246 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454288 2023-09-23T07:31:28.246 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454288 -le 1695457101 ]] 2023-09-23T07:31:28.246 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3331528018 ]] 2023-09-23T07:31:28.246 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3331528018 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\3\3\1\5\2\8\0\1\8 ]] 2023-09-23T07:31:28.246 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:31:29.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:29.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:29.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:29.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:29.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:29.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:29.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:29.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:29.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:29.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:29.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:29.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:29.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:29.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:29.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:29.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:29.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:29.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:29.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:29.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:29.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:29.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:29.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:29.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:29.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:29.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:29.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:29.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:29.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:29.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:29.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:31:29.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:29.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:29.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:29.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:29.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:29.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:29.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:29.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:29.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:30.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:30.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:30.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:30.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:30.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:30.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:30.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:30.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:30.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:30.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:30.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:30.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:30.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:30.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:30.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:30.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:30.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:30.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:31:30.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:30.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:31.455 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:31:31.454+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:31:32.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:32.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:32.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:32.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:32.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:32.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:32.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:32.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:32.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:32.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:32.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:32.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:32.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:32.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:32.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:32.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:32.364 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:31:32.362+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:31:33.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:33.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:33.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:33.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:33.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:33.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:33.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:33.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:33.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:33.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:33.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:33.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:33.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:33.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:33.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:33.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:33.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:33.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:33.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:34.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:34.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:34.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:34.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:34.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:34.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:34.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:34.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:34.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:34.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:34.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:34.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:31:34.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:34.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:34.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:34.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:34.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:34.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:34.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:34.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:34.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:34.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:34.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:34.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:35.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:35.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:35.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:35.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:35.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:35.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:35.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:35.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:35.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:35.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:35.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:35.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:35.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:35.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:35.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:35.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:35.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:35.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:35.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:35.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:36.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:36.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:36.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:36.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:36.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:36.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:36.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:36.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:36.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:36.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:36.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:36.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:36.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:37.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:37.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:36.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:37.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:37.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:37.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:37.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:37.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:37.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:37.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:37.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:38.253 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:31:38.254 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:31:38.265 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:31:38.315 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:31:38.633 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:31:38.630+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:31:39.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:39.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:39.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:39.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:39.635 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3331528018 2023-09-23T07:31:39.636 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:31:39.636 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454299 2023-09-23T07:31:39.636 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454299 -le 1695457101 ]] 2023-09-23T07:31:39.637 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3331528018 ]] 2023-09-23T07:31:39.637 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3331528018 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\3\3\1\5\2\8\0\1\8 ]] 2023-09-23T07:31:39.637 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:31:39.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:39.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:39.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:39.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:39.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:39.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:39.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:39.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:39.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:39.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:39.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:39.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:39.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:39.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:39.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:39.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:40.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:40.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:40.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:40.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:40.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:40.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:40.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:40.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:40.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:40.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:40.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:40.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:40.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:40.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:40.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:40.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:42.189 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:31:42.186+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:31:42.189 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:31:42.186+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:31:43.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:43.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:43.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:43.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:43.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:43.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:43.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:43.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:43.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:43.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:43.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:43.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:43.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:43.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:44.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:44.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:44.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:44.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:44.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:44.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:44.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:44.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:44.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:44.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:44.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:44.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:44.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:44.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:44.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:44.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:44.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:44.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:44.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:44.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:46.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:46.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:46.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:46.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:46.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:46.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:46.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:46.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:46.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:46.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:46.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:46.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:46.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:46.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:46.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:46.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:46.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:46.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:47.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:47.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:47.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:47.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:47.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:47.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:47.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:47.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:47.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:47.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:47.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:47.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:47.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:47.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:47.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:47.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:47.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:47.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:48.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:48.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:48.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:48.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:48.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:48.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:48.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:48.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:48.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:48.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:48.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:48.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:48.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:48.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:48.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:48.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:49.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:49.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:49.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:49.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:49.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:49.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:49.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:49.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:49.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:49.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:49.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:49.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:49.638 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:31:49.638 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:31:49.642 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:31:49.645 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:31:49.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:49.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:49.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:49.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:49.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:49.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:49.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:49.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:50.945 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3331528018 2023-09-23T07:31:50.946 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:31:50.947 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454310 2023-09-23T07:31:50.947 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454310 -le 1695457101 ]] 2023-09-23T07:31:50.947 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3331528018 ]] 2023-09-23T07:31:50.947 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3331528018 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\3\3\1\5\2\8\0\1\8 ]] 2023-09-23T07:31:50.948 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:31:51.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:31:51.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:51.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:51.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:51.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:51.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:51.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:51.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:51.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:51.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:51.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:51.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:51.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:31:51.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:51.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:51.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:51.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:51.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:51.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:51.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:51.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:51.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:51.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:51.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:51.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:31:51.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:51.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:51.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:51.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:51.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:51.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:51.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:51.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:51.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:51.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:51.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:51.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:51.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:51.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:51.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:51.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:51.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:51.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:51.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:51.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:51.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:54.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:54.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:54.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:54.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:54.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:54.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:54.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:54.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:54.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:54.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:31:54.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:54.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:54.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:54.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:54.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:55.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:55.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:55.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:55.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:55.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:55.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:55.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:55.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:55.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:55.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:31:55.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:55.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:55.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:55.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:55.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:55.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:55.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:55.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:55.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:55.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:56.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:56.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:56.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:56.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:56.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:56.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:56.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:56.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:56.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:56.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:31:56.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:56.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:56.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:56.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:56.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:56.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:56.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:56.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:56.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:56.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:58.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:58.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:58.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:58.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:58.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:58.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:58.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:58.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:58.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:31:58.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:31:58.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:31:58.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:31:58.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:31:58.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:31:58.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:31:58.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:31:58.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:31:58.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:31:58.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:00.953 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:32:00.954 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:32:00.958 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:32:00.967 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:32:01.058 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:01.050+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:32:01.058 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:01.050+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:32:01.058 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:01.050+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:32:01.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:01.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:01.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:01.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:01.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:01.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:01.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:01.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:01.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:01.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:01.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:01.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:01.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:01.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:02.588 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3331528018 2023-09-23T07:32:02.588 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:32:02.588 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454322 2023-09-23T07:32:02.589 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454322 -le 1695457101 ]] 2023-09-23T07:32:02.589 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3331528018 ]] 2023-09-23T07:32:02.589 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3331528018 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\3\3\1\5\2\8\0\1\8 ]] 2023-09-23T07:32:02.589 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:32:02.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:02.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:02.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:02.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:02.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:02.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:02.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:02.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:02.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:02.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:02.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:02.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:02.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:02.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:02.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:02.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:02.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:02.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:02.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:02.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:05.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:05.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:05.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:05.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:05.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:05.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:05.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:05.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:05.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:05.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:05.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:05.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:06.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:06.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:06.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:06.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:06.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:06.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:06.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:06.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:06.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:06.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:06.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:06.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:06.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:06.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:06.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:06.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:07.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:07.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:07.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:07.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:07.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:07.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:07.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:07.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:07.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:07.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:07.249 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:07.246+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:32:07.249 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:07.246+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:32:07.249 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:07.246+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:32:07.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:07.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:07.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:07.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:07.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:07.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:07.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:07.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:07.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:07.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:07.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:07.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:07.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:07.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:07.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:07.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:07.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:07.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:07.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:07.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:07.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:07.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:08.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:08.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:08.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:08.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:08.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:08.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:08.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:08.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:08.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:08.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:08.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:08.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:08.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:08.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:08.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:08.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:08.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:08.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:09.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:09.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:09.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:09.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:09.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:09.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:09.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:09.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:09.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:09.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:09.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:09.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:09.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:09.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:09.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:09.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:09.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:09.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:09.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:09.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:11.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:11.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:11.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:11.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:11.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:11.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:11.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:11.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:11.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:11.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:11.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:11.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:11.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:11.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:12.471 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:12.466+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:32:12.471 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:12.466+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:32:12.471 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:12.466+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:32:12.479 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:12.474+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:32:12.479 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:12.474+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:32:12.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:12.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:12.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:12.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:12.598 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:32:12.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:12.600 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:32:12.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:12.610 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:32:12.616 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:32:12.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:12.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:12.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:12.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:12.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:12.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:12.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:12.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:12.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:12.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:12.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:12.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:12.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:12.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:12.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:13.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:13.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:13.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:13.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:13.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:13.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:13.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:13.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:13.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:13.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:13.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:13.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:13.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:13.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:13.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:13.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:13.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:13.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:13.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:13.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:14.033 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3525840987 2023-09-23T07:32:14.051 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:32:14.052 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454334 2023-09-23T07:32:14.052 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454334 -le 1695457101 ]] 2023-09-23T07:32:14.052 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3525840987 ]] 2023-09-23T07:32:14.052 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3525840987 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\3\3\1\5\2\8\0\1\8 ]] 2023-09-23T07:32:14.052 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/3525840987 2023-09-23T07:32:15.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:15.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:15.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:15.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:15.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:15.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:15.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:15.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:15.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:15.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:15.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:15.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:15.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:15.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:15.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:15.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:15.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:15.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:15.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:16.634 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/3525840987 until 2023-09-23T08:32:16.029395+0000 (3600 sec) 2023-09-23T07:32:16.680 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:32:16.689 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/3525840987 2023-09-23T07:32:17.827 INFO:tasks.workunit.client.0.smithi107.stderr:listed 13 entries 2023-09-23T07:32:17.885 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/3525840987 2023-09-23T07:32:17.885 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:32:18.284 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:18.282+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:32:18.284 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:18.282+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:32:18.365 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:18.362+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:32:18.365 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:18.362+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:32:18.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:18.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:18.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:18.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:18.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:18.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:18.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:18.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:18.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:18.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:18.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:18.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:19.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:19.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:19.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:19.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:19.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:19.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:19.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:19.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:19.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:19.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:19.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:19.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:20.352 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:20.350+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:32:20.352 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:20.350+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:32:20.352 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:20.350+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:32:20.377 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:20.374+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:32:20.377 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:20.374+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:32:21.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:21.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:21.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:21.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:21.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:21.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:23.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:23.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:23.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:23.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:23.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:23.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:23.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:23.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:23.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:23.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:23.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:23.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:23.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:23.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:23.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:23.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:23.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:23.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:23.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:23.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:23.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:24.610 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:24.606+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:32:26.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:26.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:26.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:26.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:26.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:26.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:26.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:26.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:26.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:26.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:26.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:26.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:26.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:26.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:26.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:26.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:26.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:26.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:26.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:32:26.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:26.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:26.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:26.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:26.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:26.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:26.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:26.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:26.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:26.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:26.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:26.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:27.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:27.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:27.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:27.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:27.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:27.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:27.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:27.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:27.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:27.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:27.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:27.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:27.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:27.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:27.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:27.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:27.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:27.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:27.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:27.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:27.893 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:32:27.893 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:32:27.896 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:32:27.901 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:32:29.406 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3525840987 2023-09-23T07:32:29.406 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:32:29.432 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454349 2023-09-23T07:32:29.432 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454349 -le 1695457101 ]] 2023-09-23T07:32:29.432 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3525840987 ]] 2023-09-23T07:32:29.432 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3525840987 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\5\2\5\8\4\0\9\8\7 ]] 2023-09-23T07:32:29.432 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:32:30.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:30.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:30.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:30.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:30.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:30.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:30.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:30.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:30.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:30.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:30.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:30.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:31.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:31.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:31.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:31.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:31.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:31.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:31.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:31.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:31.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:31.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:31.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:31.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:31.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:31.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:31.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:31.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:31.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:36.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:36.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:36.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:36.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:36.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:36.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:36.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:36.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:36.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:36.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:36.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:36.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:36.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:36.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:36.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:36.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:36.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:36.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:36.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:36.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:37.160 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:37.162+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:32:37.160 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:37.162+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:32:37.161 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:37.162+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:32:38.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:38.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:38.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:38.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:38.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:38.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:38.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:38.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:38.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:38.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:38.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:38.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:38.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:38.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:38.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:38.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:38.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:38.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:38.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:38.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:38.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:38.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:38.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:39.463 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:32:39.464 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:32:39.467 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:32:39.467 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:32:40.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:32:40.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:40.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:40.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:40.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:40.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:40.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:40.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:40.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:40.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:40.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:40.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:40.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:41.150 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3525840987 2023-09-23T07:32:41.150 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:32:41.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454361 2023-09-23T07:32:41.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454361 -le 1695457101 ]] 2023-09-23T07:32:41.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3525840987 ]] 2023-09-23T07:32:41.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3525840987 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\5\2\5\8\4\0\9\8\7 ]] 2023-09-23T07:32:41.152 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:32:44.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:44.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:44.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:44.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:44.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:44.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:44.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:44.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:44.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:44.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:44.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:44.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:44.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:44.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:44.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:44.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:44.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:45.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:45.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:45.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:45.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:45.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:45.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:45.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:45.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:45.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:45.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:45.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:45.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:45.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:45.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:45.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:45.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:45.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:45.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:46.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:46.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:46.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:46.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:46.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:46.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:46.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:46.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:46.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:46.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:46.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:46.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:47.307 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:47.310+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:32:47.307 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:47.310+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:32:49.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:49.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:49.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:49.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:49.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:49.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:49.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:49.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:49.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:49.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:49.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:49.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:49.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:49.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:49.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:49.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:49.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:49.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:49.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:49.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:49.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:49.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:49.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:49.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:49.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:49.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:49.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:49.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:49.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:49.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:49.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:50.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:50.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:50.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:50.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:50.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:50.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:50.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:50.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:50.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:50.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:50.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:50.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:50.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:50.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:50.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:50.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:50.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:51.557 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:32:51.557 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:32:51.557 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:32:51.578 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:32:53.261 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3525840987 2023-09-23T07:32:53.269 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:32:53.283 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454373 2023-09-23T07:32:53.283 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454373 -le 1695457101 ]] 2023-09-23T07:32:53.283 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3525840987 ]] 2023-09-23T07:32:53.283 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3525840987 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\5\2\5\8\4\0\9\8\7 ]] 2023-09-23T07:32:53.284 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:32:53.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:53.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:53.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:53.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:53.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:53.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:53.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:53.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:53.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:53.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:53.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:53.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:53.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:53.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:53.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:53.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:54.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:54.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:54.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:54.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:54.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:54.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:54.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:54.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:54.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:54.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:54.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:54.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:54.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:54.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:54.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:54.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:54.512 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:54.513+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:32:56.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:56.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:56.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:56.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:56.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:56.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:56.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:56.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:56.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:56.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:56.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:56.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:32:56.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:56.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:56.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:56.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:56.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:56.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:56.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:56.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:56.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:56.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:56.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:56.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:56.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:56.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:56.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:56.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:56.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:56.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:56.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:56.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:32:56.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:32:56.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:56.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:56.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:56.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:56.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:56.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:56.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:56.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:57.379 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:57.377+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:32:57.392 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:32:57.393+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:32:57.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:57.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:57.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:57.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:57.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:57.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:57.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:57.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:57.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:57.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:57.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:32:57.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:57.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:57.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:57.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:57.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:57.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:57.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:57.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:32:57.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:32:57.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:32:57.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:32:57.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:32:57.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:32:57.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:32:57.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:32:57.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:32:58.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:32:57.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:00.011 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.009+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.011 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.009+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d12a54080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.012 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.013+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.012 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.013+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13be2c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.027 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.029+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.027 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.029+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13be2780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.049 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.049+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.049 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.049+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13be2e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.060 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.061+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.060 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.061+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13be2600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.087 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.085+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.087 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.085+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d139cbc00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.090 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.089+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.090 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.089+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13753c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.094 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.093+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.094 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.093+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d139caa80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.110 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.109+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.110 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.109+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13a67e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.110 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.109+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.110 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.109+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d12df5180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.111 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.113+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.112 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.113+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13752200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.114 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.113+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.115 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.113+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13753300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.130 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.129+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.130 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.129+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d1365d000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.130 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.129+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.130 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.129+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d1365c680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.133 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.133+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.133 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.133+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13a66f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.151 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.149+0000 7f9a19a5f640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.151 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.149+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.152 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.149+0000 7f9a19a5f640 -1 librbd::ImageState: 0x560d13baad00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.152 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.149+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13baab00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.190 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.189+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.190 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.189+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.190 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.189+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.190 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.189+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13baa900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.190 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.189+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13bab980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:00.191 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:33:00.189+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13bab800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:33:02.381 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:02.381+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:33:02.381 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:02.381+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:33:02.381 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:02.381+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:33:02.391 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:02.393+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:33:02.391 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:02.393+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:33:02.391 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:02.393+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:33:03.433 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:33:03.433 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:33:03.433 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:33:03.444 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:33:03.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:03.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:03.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:03.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:03.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:03.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:03.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:03.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:03.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:03.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:03.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:03.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:03.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:03.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:03.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:03.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:04.898 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3525840987 2023-09-23T07:33:04.899 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:33:04.900 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454384 2023-09-23T07:33:04.900 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454384 -le 1695457101 ]] 2023-09-23T07:33:04.900 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3525840987 ]] 2023-09-23T07:33:04.900 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3525840987 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\5\2\5\8\4\0\9\8\7 ]] 2023-09-23T07:33:04.901 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:33:05.351 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:05.353+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:33:05.382 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:05.381+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:33:05.382 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:05.381+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:33:05.382 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:05.381+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:33:06.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:06.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:06.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:06.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:06.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:06.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:06.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:06.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:06.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:06.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:06.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:06.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:06.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:06.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:06.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:06.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:06.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:06.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:07.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:07.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:07.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:07.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:07.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:07.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:07.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:07.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:07.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:07.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:07.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:07.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:07.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:07.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:07.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:07.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:07.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:07.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:07.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:07.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:08.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:08.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:08.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:08.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:08.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:08.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:08.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:08.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:08.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:08.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:08.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:08.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:08.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:08.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:08.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:08.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:08.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:08.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:08.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:08.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:12.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:12.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:12.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:12.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:12.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:12.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:12.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:12.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:12.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:12.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:12.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:12.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:13.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:13.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:13.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:13.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:13.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:13.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:13.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:13.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:13.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:33:13.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:13.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:13.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:13.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:13.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:13.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:13.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:13.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:13.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:13.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:13.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:13.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:14.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:14.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:14.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:14.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:14.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:14.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:14.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:14.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:14.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:14.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:14.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:14.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:14.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:14.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:14.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:14.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:14.927 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:33:14.928 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:33:14.945 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:33:14.951 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:33:15.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:15.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:15.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:15.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:15.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:15.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:15.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:15.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:15.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:15.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:15.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:15.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:15.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:15.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:15.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:15.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:15.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:15.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:15.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:15.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:15.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:16.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:16.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:16.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:16.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:16.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:16.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:16.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:16.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:16.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:16.265 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/3525840987 2023-09-23T07:33:16.272 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:33:16.273 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454396 2023-09-23T07:33:16.274 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454396 -le 1695457101 ]] 2023-09-23T07:33:16.274 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/3525840987 ]] 2023-09-23T07:33:16.274 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/3525840987 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\5\2\5\8\4\0\9\8\7 ]] 2023-09-23T07:33:16.274 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:33:16.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:16.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:16.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:16.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:16.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:16.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:16.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:17.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:17.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:17.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:17.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:17.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:17.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:17.245 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:17.245+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:33:17.245 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:17.245+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:33:17.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:17.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:17.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:17.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:17.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:17.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:17.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:17.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:17.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:17.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:17.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:17.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:18.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:18.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:18.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:18.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:18.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:18.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:18.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:18.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:18.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:18.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:18.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:18.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:18.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:18.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:18.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:18.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:18.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:18.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:18.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:18.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:19.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:19.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:19.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:19.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:19.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:19.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:19.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:19.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:21.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:21.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:21.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:21.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:21.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:21.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:21.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:21.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:21.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:21.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:22.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:22.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:22.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:22.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:22.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:22.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:22.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:22.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:22.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:22.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:22.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:22.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:22.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:22.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:22.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:22.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:23.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:23.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:23.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:23.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:23.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:23.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:23.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:23.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:23.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:23.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:33:23.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:23.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:23.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:23.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:23.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:23.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:23.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:23.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:23.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:23.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:23.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:23.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:23.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:23.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:23.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:23.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:23.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:23.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:23.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:23.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:23.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:24.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:24.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:24.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:24.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:24.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:24.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:24.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:24.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:24.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:24.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:24.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:24.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:33:24.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:24.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:24.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:24.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:24.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:24.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:24.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:24.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:24.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:24.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:24.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:24.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:26.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:26.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:26.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:26.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:26.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:26.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:26.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:26.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:26.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:26.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:26.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:26.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:26.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:26.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:26.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:26.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:26.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:26.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:26.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:26.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:26.278 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:33:26.281 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:33:26.281 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:33:26.287 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:33:26.674 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:33:26.673+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:33:27.617 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:33:27.625 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:33:27.626 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454407 2023-09-23T07:33:27.626 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454407 -le 1695457101 ]] 2023-09-23T07:33:27.627 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:33:27.627 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\3\5\2\5\8\4\0\9\8\7 ]] 2023-09-23T07:33:27.646 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist add 172.21.15.107:0/1631903394 2023-09-23T07:33:28.717 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:28.717+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:33:28.717 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:28.717+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:33:28.717 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:28.717+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:33:28.717 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:28.717+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:33:29.649 INFO:tasks.workunit.client.0.smithi107.stderr:blocklisting 172.21.15.107:0/1631903394 until 2023-09-23T08:33:29.050416+0000 (3600 sec) 2023-09-23T07:33:29.708 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep -q 172.21.15.107:0/1631903394 2023-09-23T07:33:29.719 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph osd blocklist ls 2023-09-23T07:33:30.762 INFO:tasks.workunit.client.0.smithi107.stderr:listed 14 entries 2023-09-23T07:33:30.825 INFO:tasks.workunit.client.0.smithi107.stderr:+ PREV_CLIENT=172.21.15.107:0/1631903394 2023-09-23T07:33:30.825 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:33:31.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:31.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:31.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:31.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:31.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:31.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:31.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:31.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:31.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:31.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:31.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:31.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:31.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:31.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:31.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:31.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:31.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:31.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:31.633 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:31.633+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:33:31.633 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:31.633+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:33:31.633 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:31.633+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:33:32.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:32.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:32.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:32.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:32.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:32.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:32.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:32.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:32.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:32.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:32.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:32.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:32.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:32.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:32.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:32.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:32.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:32.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:32.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:32.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:32.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:32.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:32.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:32.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:32.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:32.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:34.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:34.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:34.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:34.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:34.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:34.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:34.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:34.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:34.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:34.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:34.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:34.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:34.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:34.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:34.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:34.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:34.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:34.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:34.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:34.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:34.885 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:34.885+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:33:34.885 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:34.885+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:33:35.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:35.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:35.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:35.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:35.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:35.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:35.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:35.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:35.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:33:35.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:35.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:35.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:35.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:35.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:35.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:35.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:35.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:35.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:35.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:36.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:36.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:36.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:36.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:36.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:36.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:36.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:36.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:37.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:37.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:37.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:37.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:37.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:33:37.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:37.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:37.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:37.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:37.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:37.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:37.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:37.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:37.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:37.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:38.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:38.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:38.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:38.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:38.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:38.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:38.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:38.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:38.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:38.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:38.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:38.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:38.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:38.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:38.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:38.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:38.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:38.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:38.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:38.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:39.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:39.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:39.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:39.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:39.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:39.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:39.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:39.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:39.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:39.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:39.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:39.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:40.071 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:40.073+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:33:40.071 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:40.073+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:33:40.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:40.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:40.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:40.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:40.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:40.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:40.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:40.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:40.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:33:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:33:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:33:40.889 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:33:40.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:40.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:40.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:40.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:40.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:41.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:41.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:41.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:41.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:41.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:41.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:41.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:41.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:41.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:41.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:42.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:42.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:42.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:42.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:42.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:42.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:42.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:42.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:42.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:42.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:42.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:42.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:42.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:42.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:42.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:42.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:42.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:42.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:42.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:42.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:42.471 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:33:42.472 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:33:42.476 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454422 2023-09-23T07:33:42.476 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454422 -le 1695457101 ]] 2023-09-23T07:33:42.491 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:33:42.491 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:33:42.491 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:33:43.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:43.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:43.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:43.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:43.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:43.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:43.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:43.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:43.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:43.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:43.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:43.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:44.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:44.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:44.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:44.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:44.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:44.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:44.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:44.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:44.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:44.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:44.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:44.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:44.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:44.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:45.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:45.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:45.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:45.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:45.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:45.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:47.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:47.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:47.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:47.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:47.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:47.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:47.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:47.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:47.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:47.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:47.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:47.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:47.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:47.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:47.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:47.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:47.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:47.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:48.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:48.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:48.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:48.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:48.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:48.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:48.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:48.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:48.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:48.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:49.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:49.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:49.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:49.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:50.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:50.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:50.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:50.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:50.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:50.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:50.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:50.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:50.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:50.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:50.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:50.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:51.047 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:51.049+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:33:51.048 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:33:51.049+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:33:51.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:51.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:33:51.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:51.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:33:51.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:51.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:51.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:51.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:51.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:51.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:51.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:51.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:51.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:51.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:51.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:51.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:51.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:51.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:51.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:51.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:52.635 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:33:52.643 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:33:52.648 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:33:52.682 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:33:54.112 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:33:54.114 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:33:54.115 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454434 2023-09-23T07:33:54.116 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454434 -le 1695457101 ]] 2023-09-23T07:33:54.116 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:33:54.116 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:33:54.116 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:33:57.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:57.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:57.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:57.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:57.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:57.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:57.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:57.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:57.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:57.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:57.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:57.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:57.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:57.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:57.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:57.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:57.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:57.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:33:59.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:59.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:33:59.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:59.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:33:59.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:59.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:33:59.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:59.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:33:59.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:59.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:33:59.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:59.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:33:59.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:59.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:33:59.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:59.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:33:59.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:33:59.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:00.026 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.025+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.026 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.025+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.026 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.025+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d1304b500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.026 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.025+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13baa600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.027 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.029+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.027 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.029+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13baa380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.027 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.029+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.027 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.029+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13bab500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.041 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.041+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.041 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.041+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13bab680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.042 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.041+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.042 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.041+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13752c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.053 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.053+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.053 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.053+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139ca180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.078 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.077+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.079 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.077+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139cbb00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.095 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.097+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.095 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.097+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13752980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.102 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.101+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.102 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.101+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.103 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.101+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13657200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.103 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.101+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13a66580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.103 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.105+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.103 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.105+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d139cbe00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.106 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.109+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.106 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.109+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13be2b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.109 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.109+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.110 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.109+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13be2500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.112 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.113+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.112 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.113+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13be2000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.116 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.117+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.116 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.117+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13bd1080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.131 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.133+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.131 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.133+0000 7f9a18a5d640 -1 librbd::ImageState: 0x560d13bd0e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.139 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.141+0000 7f9a18a5d640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.139 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.141+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13bd0c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.139 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.141+0000 7f9a1925e640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.139 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T07:34:00.141+0000 7f9a1925e640 -1 librbd::ImageState: 0x560d13bd0400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-09-23T07:34:00.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:00.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:00.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:00.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:00.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:00.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:00.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:00.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:00.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:00.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:00.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:00.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:00.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:00.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:00.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:00.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:00.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:00.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:00.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:00.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:01.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:01.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:01.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:01.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:01.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:01.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:01.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:01.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:01.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:01.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:01.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:01.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:01.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:01.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:01.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:01.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:01.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:01.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:01.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:01.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:01.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:01.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:01.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:01.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:01.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:01.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:01.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:01.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:01.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:01.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:01.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:02.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:34:02.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:02.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:02.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:02.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:02.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:02.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:02.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:02.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:02.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:02.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:02.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:02.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:03.001 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:34:03.001+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:34:03.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:03.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:03.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:03.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:03.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:03.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:03.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:03.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:03.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:03.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:03.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:03.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:03.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:03.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:03.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:03.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:03.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:03.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:03.684 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:34:03.685+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:34:03.684 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:34:03.685+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:34:04.161 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:34:04.165 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:34:04.168 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:34:04.180 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:34:05.556 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:34:05.556 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:34:05.564 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454445 2023-09-23T07:34:05.564 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454445 -le 1695457101 ]] 2023-09-23T07:34:05.564 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:34:05.564 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:34:05.564 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:34:06.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:06.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:06.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:06.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:06.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:06.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:06.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:06.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:06.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:06.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:06.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:06.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:06.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:06.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:06.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:06.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:06.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:06.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:06.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:06.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:08.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:08.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:08.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:08.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:08.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:08.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:08.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:08.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:08.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:08.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:08.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:08.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:08.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:08.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:08.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:08.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:08.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:09.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:09.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:10.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:10.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:10.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:10.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:10.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:10.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:10.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:10.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:10.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:10.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:10.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:10.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:10.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:10.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:10.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:10.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:10.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:10.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:10.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:10.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:11.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:11.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:11.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:11.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:11.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:11.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:11.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:11.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:11.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:11.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:11.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:11.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:11.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:11.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:11.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:11.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:11.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:11.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:14.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:14.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:14.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:14.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:14.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:14.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:14.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:14.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:14.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:14.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:14.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:14.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:14.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:14.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:14.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:14.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:14.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:14.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:15.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:15.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:15.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:15.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:15.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:15.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:15.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:15.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:15.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:15.573 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:34:15.576 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:34:15.586 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:34:15.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:15.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:15.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:15.599 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:34:16.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:16.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:16.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:16.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:16.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:16.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:16.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:16.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:16.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:16.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:16.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:16.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:16.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:16.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:16.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:16.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:16.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:16.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:16.940 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:34:16.940 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:34:16.941 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454456 2023-09-23T07:34:16.941 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454456 -le 1695457101 ]] 2023-09-23T07:34:16.941 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:34:16.941 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:34:16.941 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:34:18.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:18.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:18.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:18.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:18.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:18.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:18.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:18.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:18.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:18.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:18.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:18.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:18.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:18.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:18.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:18.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:18.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:18.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:18.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:18.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:18.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:19.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:19.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:19.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:19.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:19.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:19.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:19.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:19.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:19.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:19.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:19.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:19.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:19.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:19.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:19.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:19.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:20.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:20.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:21.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:21.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:21.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:21.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:21.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:21.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:21.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:21.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:21.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:21.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:21.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:21.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:21.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:21.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:21.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:21.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:21.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:22.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:22.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:22.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:22.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:22.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:22.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:22.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:22.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:23.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:22.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:23.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:23.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:23.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:23.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:34:23.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:23.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:23.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:23.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:23.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:23.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:23.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:23.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:23.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:23.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:23.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:23.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:23.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:23.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:23.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:23.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:23.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:23.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:23.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:23.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:23.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:23.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:23.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:23.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:23.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:23.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:23.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:23.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:23.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:23.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:23.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:23.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:25.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:25.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:25.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:25.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:25.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:25.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:25.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:25.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:25.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:25.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:25.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:25.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:26.958 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:34:26.959 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:34:26.959 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:34:26.960 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:34:28.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:28.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:28.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:28.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:28.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:28.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:28.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:28.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:28.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:28.421 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:34:28.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:28.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:28.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:28.440 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:34:28.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454468 2023-09-23T07:34:28.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454468 -le 1695457101 ]] 2023-09-23T07:34:28.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:34:28.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:34:28.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:34:29.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:29.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:29.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:29.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:29.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:29.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:29.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:29.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:29.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:29.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:29.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:29.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:30.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:30.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:30.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:30.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:30.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:30.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:30.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:30.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:30.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:30.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:34:30.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:30.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:30.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:30.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:30.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:30.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:30.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:30.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:30.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:30.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:30.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:30.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:31.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:31.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:31.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:31.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:31.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:31.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:31.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:31.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:31.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:31.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:31.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:31.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:31.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:31.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:31.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:31.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:31.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:31.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:31.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:31.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:31.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:32.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:32.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:32.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:32.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:32.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:32.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:32.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:32.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:32.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:32.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:32.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:32.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:34:32.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:32.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:32.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:32.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:32.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:32.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:32.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:32.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:32.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:32.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:32.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:32.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:34.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:34.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:34.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:34.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:34.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:34.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:34.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:34.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:34.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:34.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:34.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:34.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:34.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:34.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:34.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:34.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:34.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:35.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:35.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:35.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:35.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:35.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:35.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:35.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:35.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:35.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:35.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:35.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:35.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:35.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:35.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:35.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:35.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:35.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:35.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:35.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:35.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:35.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:35.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:35.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:35.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:35.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:35.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:35.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:35.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:36.770 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:34:36.768+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:34:36.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:36.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:36.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:36.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:36.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:36.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:36.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:36.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:36.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:36.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:36.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:36.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:36.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:36.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:36.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:36.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:36.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:36.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:38.452 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:34:38.452 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:34:38.452 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:34:38.453 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:34:38.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:38.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:38.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:38.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:38.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:38.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:38.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:38.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:38.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:38.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:38.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:38.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:39.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:39.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:39.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:39.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:39.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:39.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:39.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:39.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:39.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:39.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:39.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:39.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:39.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:39.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:39.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:39.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:39.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:39.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:39.924 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:34:39.925 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:34:39.925 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454479 2023-09-23T07:34:39.925 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454479 -le 1695457101 ]] 2023-09-23T07:34:39.925 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:34:39.925 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:34:39.926 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:34:40.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:40.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:40.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:40.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:40.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:40.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:40.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:40.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:40.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:40.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:40.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:40.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:42.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:42.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:42.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:42.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:42.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:42.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:42.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:42.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:42.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:42.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:42.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:42.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:42.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:42.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:42.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:42.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:42.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:42.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:42.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:42.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:44.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:44.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:44.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:44.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:44.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:44.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:44.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:44.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:44.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:44.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:44.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:44.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:44.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:44.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:44.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:44.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:44.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:44.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:45.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:45.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:45.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:45.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:45.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:45.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:45.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:45.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:45.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:45.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:45.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:45.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:46.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:46.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:46.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:46.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:46.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:46.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:46.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:46.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:46.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:46.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:46.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:46.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:46.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:46.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:46.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:46.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:46.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:46.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:46.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:46.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:47.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:47.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:47.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:47.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:47.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:47.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:47.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:47.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:47.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:47.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:34:47.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:47.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:47.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:47.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:47.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:47.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:47.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:47.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:47.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:47.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:47.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:47.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:47.946 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:34:47.944+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:34:47.946 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:34:47.944+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:34:48.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:48.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:48.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:48.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:48.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:48.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:48.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:48.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:48.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:48.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:48.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:48.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:48.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:48.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:48.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:49.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:49.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:49.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:49.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:49.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:49.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:49.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:49.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:49.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:49.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:49.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:49.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:49.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:49.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:49.935 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:34:49.936 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:34:49.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:49.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:49.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:49.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:49.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:49.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:49.959 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:34:49.970 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:34:49.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:50.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:50.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:50.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:50.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:50.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:50.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:50.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:50.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:50.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:50.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:50.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:50.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:50.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:51.314 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:34:51.318 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:34:51.319 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454491 2023-09-23T07:34:51.320 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454491 -le 1695457101 ]] 2023-09-23T07:34:51.320 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:34:51.320 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:34:51.320 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:34:53.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:34:53.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:53.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:53.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:53.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:53.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:53.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:53.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:53.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:53.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:53.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:53.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:53.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:55.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:55.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:55.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:55.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:55.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:55.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:55.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:55.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:55.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:55.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:55.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:55.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:55.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:55.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:55.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:55.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:55.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:55.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:55.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:55.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:55.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:55.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:55.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:55.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:34:56.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:34:56.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:56.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:56.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:56.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:56.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:56.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:56.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:56.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:56.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:56.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:56.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:56.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:56.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:56.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:56.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:56.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:56.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:56.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:57.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:34:57.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:57.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:57.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:57.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:57.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:57.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:57.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:57.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:57.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:57.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:57.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:57.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:57.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:58.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:58.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:58.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:58.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:58.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:58.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:58.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:58.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:58.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:58.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:58.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:58.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:58.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:58.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:58.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:58.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:34:59.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:59.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:34:59.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:59.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:34:59.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:59.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:34:59.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:59.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:34:59.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:59.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:34:59.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:59.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:34:59.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:59.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:34:59.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:59.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:34:59.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:34:59.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:01.324 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:35:01.324 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:35:01.324 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:35:01.334 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:35:02.088 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:02.084+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:35:02.088 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:02.084+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:35:02.537 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:35:02.537 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:35:02.538 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454502 2023-09-23T07:35:02.538 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454502 -le 1695457101 ]] 2023-09-23T07:35:02.538 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:35:02.538 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:35:02.538 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:35:03.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:03.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:04.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:04.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:04.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:04.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:04.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:04.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:04.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:04.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:04.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:04.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:04.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:04.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:04.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:04.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:04.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:04.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:04.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:04.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:04.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:04.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:05.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:05.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:05.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:05.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:05.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:05.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:05.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:05.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:05.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:05.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:05.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:05.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:05.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:05.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:05.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:05.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:06.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:06.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:06.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:06.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:06.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:06.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:06.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:06.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:06.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:06.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:06.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:06.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:06.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:06.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:06.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:06.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:06.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:06.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:06.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:06.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:07.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:07.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:07.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:07.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:07.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:07.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:07.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:07.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:07.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:07.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:07.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:35:07.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:07.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:07.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:07.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:07.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:07.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:07.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:07.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:07.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:07.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:07.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:07.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:08.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:08.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:08.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:08.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:08.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:08.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:08.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:08.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:08.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:08.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:08.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:08.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:08.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:08.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:08.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:08.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:08.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:08.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:08.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:08.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:11.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:11.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:11.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:11.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:11.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:11.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:11.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:11.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:11.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:11.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:11.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:11.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:11.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:11.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:11.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:11.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:11.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:11.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:12.543 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:35:12.544 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:35:12.550 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:35:12.557 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:35:12.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:12.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:12.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:12.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:12.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:12.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:12.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:12.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:12.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:12.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:12.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:12.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:12.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:12.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:12.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:12.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:12.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:12.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:12.874 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:12.871+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:35:13.926 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:13.923+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:35:14.027 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:35:14.027 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:35:14.030 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454514 2023-09-23T07:35:14.031 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454514 -le 1695457101 ]] 2023-09-23T07:35:14.031 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:35:14.031 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:35:14.031 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:35:14.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:14.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:14.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:14.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:14.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:14.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:14.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:14.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:14.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:14.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:14.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:14.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:14.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:14.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:15.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:15.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:15.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:15.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:15.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:15.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:15.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:15.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:15.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:15.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:15.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:15.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:16.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:16.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:16.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:16.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:16.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:16.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:16.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:16.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:16.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:16.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:16.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:16.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:16.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:16.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:16.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:16.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:16.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:16.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:16.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:16.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:18.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:18.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:18.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:18.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:18.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:18.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:18.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:18.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:18.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:18.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:18.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:18.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:18.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:18.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:18.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:18.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:18.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:18.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:22.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:22.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:22.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:22.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:22.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:22.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:22.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:22.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:22.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:22.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:22.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:22.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:22.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:22.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:22.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:22.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:22.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:22.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:24.034 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:35:24.037 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:35:24.038 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:35:24.042 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:35:25.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:25.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:25.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:25.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:25.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:25.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:25.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:25.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:25.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:25.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:25.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:25.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:25.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:25.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:25.469 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:35:25.469 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:35:25.470 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454525 2023-09-23T07:35:25.470 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454525 -le 1695457101 ]] 2023-09-23T07:35:25.470 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:35:25.470 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:35:25.470 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:35:25.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:25.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:25.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:25.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:25.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:25.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:25.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:25.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:26.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:26.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:26.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:26.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:26.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:26.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:26.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:26.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:26.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:26.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:26.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:26.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:32.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:32.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:32.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:32.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:32.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:32.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:32.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:32.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:32.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:32.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:32.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:32.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:32.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:32.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:32.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:32.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:32.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:32.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:34.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:34.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:34.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:34.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:34.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:34.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:34.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:34.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:34.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:34.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:34.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:34.416 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:34.415+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:35:34.422 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:34.419+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:35:34.423 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:34.419+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:35:34.423 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:34.419+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:35:34.445 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:34.435+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:35:34.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:34.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:34.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:34.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:34.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:34.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:35.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:35.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:35.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:35.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:35.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:35.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:35.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:35.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:35.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:35.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:35.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:35.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:35.473 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:35:35.473 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:35:35.474 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:35:35.505 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:35:36.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:36.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:36.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:36.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:36.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:36.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:36.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:36.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:36.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:36.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:36.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:36.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:37.006 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:35:37.007 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:35:37.007 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454537 2023-09-23T07:35:37.007 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454537 -le 1695457101 ]] 2023-09-23T07:35:37.007 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:35:37.007 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:35:37.007 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:35:37.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:37.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:37.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:37.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:37.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:37.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:37.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:37.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:37.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:37.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:37.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:37.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:38.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:38.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:35:38.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:38.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:38.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:38.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:39.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:38.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:39.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:38.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:39.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:39.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:39.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:39.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:39.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:39.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:39.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:39.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:39.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:39.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:39.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:39.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:39.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:39.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:39.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:39.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:39.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:39.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:35:39.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:39.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:39.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:39.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:39.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:39.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:39.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:39.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:39.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:39.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:39.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:39.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:39.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:39.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:39.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:39.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:39.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:39.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:39.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:39.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:41.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:41.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:41.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:41.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:41.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:41.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:41.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:41.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:41.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:41.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:41.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:41.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:41.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:41.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:41.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:41.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:41.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:41.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:42.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:42.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:42.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:42.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:42.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:42.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:42.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:42.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:42.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:42.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:42.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:42.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:42.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:42.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:42.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:42.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:42.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:42.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:44.838 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:44.835+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:35:44.838 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:44.835+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:35:44.838 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:44.835+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:35:46.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:46.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:46.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:46.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:46.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:46.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:46.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:46.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:46.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:46.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:46.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:46.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:47.012 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:35:47.012 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:35:47.027 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:35:47.028 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:35:48.264 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:35:48.264 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:35:48.265 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454548 2023-09-23T07:35:48.265 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454548 -le 1695457101 ]] 2023-09-23T07:35:48.265 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:35:48.265 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:35:48.266 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:35:50.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:50.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:50.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:50.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:50.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:50.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:50.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:50.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:50.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:50.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:50.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:50.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:50.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:50.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:50.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:50.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:51.388 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:51.387+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:35:51.388 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:51.387+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:35:51.388 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:35:51.387+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:35:52.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:52.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:52.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:52.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:52.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:52.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:52.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:52.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:52.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:52.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:52.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:52.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:52.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:52.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:52.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:52.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:52.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:52.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:52.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:52.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:53.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:53.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:53.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:53.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:53.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:53.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:53.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:53.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:53.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:53.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:53.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:53.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:53.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:53.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:53.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:53.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:53.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:53.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:53.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:53.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:53.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:53.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:53.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:53.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:53.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:53.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:53.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:53.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:53.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:54.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:54.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:54.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:54.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:54.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:54.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:54.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:54.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:54.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:54.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:54.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:54.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:54.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:54.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:54.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:54.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:54.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:54.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:54.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:54.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:54.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:54.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:54.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:54.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:54.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:54.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:56.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:56.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:56.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:56.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:56.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:56.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:56.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:56.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:56.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:56.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:56.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:56.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:56.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:56.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:56.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:56.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:56.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:57.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:57.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:57.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:35:57.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:35:57.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:35:57.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:35:57.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:57.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:57.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:57.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:57.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:57.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:57.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:57.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:57.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:58.276 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:35:58.289 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:35:58.289 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:35:58.298 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:35:58.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:58.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:35:58.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:58.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:35:58.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:58.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:35:58.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:58.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:35:58.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:58.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:35:58.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:58.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:35:58.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:58.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:35:58.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:35:58.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:35:59.526 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:35:59.526 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:35:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454559 2023-09-23T07:35:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454559 -le 1695457101 ]] 2023-09-23T07:35:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:35:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:35:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:36:00.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:00.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:00.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:00.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:00.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:00.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:00.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:00.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:00.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:00.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:00.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:00.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:00.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:00.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:00.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:00.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:00.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:00.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:00.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:00.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:01.308 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:01.306+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:36:01.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:01.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:01.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:01.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:01.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:01.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:01.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:01.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:01.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:01.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:01.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:01.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:01.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:01.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:01.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:01.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:01.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:01.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:01.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:01.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:03.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:03.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:03.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:03.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:03.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:03.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:03.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:03.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:03.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:03.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:03.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:03.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:03.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:03.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:03.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:03.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:03.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:03.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:04.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:04.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:04.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:04.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:04.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:04.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:04.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:04.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:04.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:04.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:36:04.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:04.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:04.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:04.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:04.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:04.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:04.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:04.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:04.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:04.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:04.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:04.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:04.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:04.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:04.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:04.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:04.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:04.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:04.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:04.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:04.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:04.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:04.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:04.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:04.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:04.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:04.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:04.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:04.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:04.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:04.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:05.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:05.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:05.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:05.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:05.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:05.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:05.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:05.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:05.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:05.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:05.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:05.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:05.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:05.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:05.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:05.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:05.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:05.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:05.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:05.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:05.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:05.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:05.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:05.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:05.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:06.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:06.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:06.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:06.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:06.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:06.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:36:06.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:06.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:06.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:06.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:06.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:06.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:06.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:06.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:06.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:06.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:36:06.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:06.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:06.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:06.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:06.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:06.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:06.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:06.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:06.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:06.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:06.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:06.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:06.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:06.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:06.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:06.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:06.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:06.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:06.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:06.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:06.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:06.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:06.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:06.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:06.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:06.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:06.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:06.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:09.536 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:36:09.536 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:36:09.539 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:36:09.543 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:36:10.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:10.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:36:10.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:10.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:10.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:10.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:10.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:10.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:10.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:10.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:10.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:10.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:10.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:10.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:10.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:10.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:10.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:10.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:10.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:10.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:10.995 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:36:11.005 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:36:11.006 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454571 2023-09-23T07:36:11.006 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454571 -le 1695457101 ]] 2023-09-23T07:36:11.006 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:36:11.007 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:36:11.007 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:36:12.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:12.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:12.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:12.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:12.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:12.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:12.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:12.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:12.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:12.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:12.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:12.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:12.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:12.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:12.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:12.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:12.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:12.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:13.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:13.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:13.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:13.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:13.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:13.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:13.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:13.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:13.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:13.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:13.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:36:13.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:13.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:13.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:13.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:13.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:13.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:13.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:13.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:13.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:13.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:13.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:13.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:14.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:14.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:14.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:14.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:14.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:14.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:14.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:14.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:14.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:14.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:14.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:14.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:16.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:16.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:16.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:16.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:16.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:16.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:16.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:16.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:16.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:16.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:16.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:16.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:16.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:16.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:16.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:16.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:16.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:16.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:17.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:17.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:17.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:17.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:17.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:17.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:17.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:17.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:17.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:17.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:17.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:17.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:17.510 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:17.502+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:36:17.510 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:17.502+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:36:18.387 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:36:18.386+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:36:18.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:18.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:18.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:18.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:18.885 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:18.878+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:36:18.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:18.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:18.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:18.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:18.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:18.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:18.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:18.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:18.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:18.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:18.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:18.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:18.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:18.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:18.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:18.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:20.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:20.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:20.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:20.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:20.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:20.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:20.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:20.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:20.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:20.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:20.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:20.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:20.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:20.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:20.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:20.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:20.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:20.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:20.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:20.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:20.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:20.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:21.020 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:36:21.020 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:36:21.023 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:36:21.044 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:36:21.959 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:36:21.954+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:36:22.137 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:36:22.144 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:36:22.145 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454582 2023-09-23T07:36:22.146 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454582 -le 1695457101 ]] 2023-09-23T07:36:22.146 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:36:22.146 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:36:22.146 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:36:24.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:36:24.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:24.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:24.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:24.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:24.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:24.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:24.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:24.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:24.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:24.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:24.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:24.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:26.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:26.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:26.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:26.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:26.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:26.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:26.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:26.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:26.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:26.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:26.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:26.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:28.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:28.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:28.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:28.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:28.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:28.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:29.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:29.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:29.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:29.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:29.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:29.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:29.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:29.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:29.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:29.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:29.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:29.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:29.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:29.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:29.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:29.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:29.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:31.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:31.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:31.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:31.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:31.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:31.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:31.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:31.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:31.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:31.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:31.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:31.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:31.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:31.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:31.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:31.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:31.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:31.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:31.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:31.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:32.161 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:36:32.161 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:36:32.167 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:36:32.168 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:36:33.314 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:36:33.314 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:36:33.315 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454593 2023-09-23T07:36:33.315 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454593 -le 1695457101 ]] 2023-09-23T07:36:33.315 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:36:33.315 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:36:33.315 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:36:33.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:36:33.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:33.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:33.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:33.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:33.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:33.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:33.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:33.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:33.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:33.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:33.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:33.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:34.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:34.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:34.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:34.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:34.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:34.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:34.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:34.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:34.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:34.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:34.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:34.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:34.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:34.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:34.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:34.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:34.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:34.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:34.432 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:34.430+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:36:34.432 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:34.430+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:36:38.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:38.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:38.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:38.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:38.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:38.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:38.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:38.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:38.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:38.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:38.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:38.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:38.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:38.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:39.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:39.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:39.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:39.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:39.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:39.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:39.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:39.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:36:39.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:39.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:39.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:39.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:39.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:39.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:39.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:39.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:39.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:40.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:40.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:40.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:40.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:40.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:40.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:40.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:40.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:40.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:40.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:40.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:40.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:40.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:40.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:40.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:40.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:40.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:40.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:40.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:41.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:41.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:41.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:41.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:41.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:41.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:41.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:41.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:41.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:41.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:41.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:41.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:41.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:41.868 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:41.866+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:36:41.868 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:41.866+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:36:41.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:41.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:41.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:41.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:41.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:41.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:41.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:43.318 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:36:43.318 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:36:43.323 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:36:43.327 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:36:43.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:43.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:43.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:43.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:43.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:43.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:43.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:43.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:36:43.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:43.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:43.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:43.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:43.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:43.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:43.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:43.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:43.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:43.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:43.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:43.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:43.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:43.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:43.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:43.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:43.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:43.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:43.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:43.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:44.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:44.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:44.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:44.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:44.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:44.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:44.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:44.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:44.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:44.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:44.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:44.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:44.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:44.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:44.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:44.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:44.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:44.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:44.750 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:36:44.750 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:36:44.751 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454604 2023-09-23T07:36:44.751 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454604 -le 1695457101 ]] 2023-09-23T07:36:44.751 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:36:44.751 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:36:44.752 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:36:48.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:48.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:48.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:48.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:48.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:48.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:48.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:48.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:48.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:48.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:48.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:48.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:48.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:48.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:48.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:48.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:48.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:48.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:48.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:48.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:48.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:48.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:49.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:49.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:49.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:49.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:49.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:49.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:49.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:49.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:49.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:49.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:49.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:49.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:49.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:49.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:49.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:49.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:49.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:49.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:50.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:50.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:50.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:50.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:50.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:50.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:50.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:50.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:50.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:50.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:50.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:50.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:50.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:50.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:50.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:50.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:50.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:50.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:51.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:51.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:51.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:51.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:51.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:51.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:51.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:51.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:51.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:51.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:51.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:51.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:51.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:51.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:51.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:51.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:51.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:51.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:51.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:53.288 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:53.289+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:36:53.288 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:53.289+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:36:54.756 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:36:54.756 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:36:54.756 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:36:54.758 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:36:55.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:55.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:55.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:55.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:55.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:55.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:55.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:55.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:55.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:55.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:55.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:55.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:56.035 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:36:56.035 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:36:56.036 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454616 2023-09-23T07:36:56.036 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454616 -le 1695457101 ]] 2023-09-23T07:36:56.036 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:36:56.036 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:36:56.036 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:36:56.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:56.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:56.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:56.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:56.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:56.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:56.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:56.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:56.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:56.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:56.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:56.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:56.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:56.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:56.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:56.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:56.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:56.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:57.298 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:57.297+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:36:57.299 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:57.297+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:36:57.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:57.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:57.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:57.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:57.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:57.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:57.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:57.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:57.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:57.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:57.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:57.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:57.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:57.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:57.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:57.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:58.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:36:58.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:58.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:58.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:58.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:58.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:58.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:58.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:58.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:58.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:58.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:36:58.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:36:58.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:36:58.562 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:58.561+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:36:58.563 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:36:58.561+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:36:58.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:36:58.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:36:58.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:36:58.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:36:58.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:36:58.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:36:58.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:36:58.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:36:58.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:36:58.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:01.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:37:01.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:01.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:01.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:01.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:01.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:01.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:01.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:01.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:01.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:01.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:01.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:02.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:02.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:02.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:02.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:02.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:02.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:02.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:02.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:02.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:02.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:02.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:02.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:02.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:02.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:02.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:02.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:02.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:02.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:04.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:04.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:04.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:04.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:04.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:04.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:04.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:04.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:04.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:04.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:04.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:04.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:37:04.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:04.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:04.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:04.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:04.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:04.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:04.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:04.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:04.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:04.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:04.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:04.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:37:04.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:04.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:04.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:04.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:04.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:04.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:04.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:04.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:04.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:04.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:04.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:04.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:37:04.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:04.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:04.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:04.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:04.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:04.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:04.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:04.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:04.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:04.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:04.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:04.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:04.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:04.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:04.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:04.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:04.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:04.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:04.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:04.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:06.061 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:37:06.062 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:37:06.062 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:37:06.064 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:37:07.632 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:37:07.632 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:37:07.633 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454627 2023-09-23T07:37:07.633 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454627 -le 1695457101 ]] 2023-09-23T07:37:07.633 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:37:07.633 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:37:07.634 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:37:07.919 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:07.917+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:37:07.919 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:07.917+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:37:11.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:11.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:11.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:11.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:11.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:11.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:11.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:11.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:11.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:11.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:11.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:11.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:12.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:12.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:12.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:12.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:12.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:12.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:12.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:12.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:12.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:12.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:12.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:12.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:12.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:12.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:12.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:12.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:12.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:12.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:12.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:12.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:12.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:13.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:13.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:13.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:13.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:13.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:13.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:13.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:13.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:13.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:13.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:13.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:13.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:13.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:13.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:13.595 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:13.593+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:37:13.595 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:13.593+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:37:13.595 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:13.593+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:37:13.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:13.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:13.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:13.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:14.115 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:14.113+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:37:14.122 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:14.121+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:37:14.122 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:14.121+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:37:14.133 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:14.133+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:37:14.133 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:14.133+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:37:14.133 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:14.133+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:37:14.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:14.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:14.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:14.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:14.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:14.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:14.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:14.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:14.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:14.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:14.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:14.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:14.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:14.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:14.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:14.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:14.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:14.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:14.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:14.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:14.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:14.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:14.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:15.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:15.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:15.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:15.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:15.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:15.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:15.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:15.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:15.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:15.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:15.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:15.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:15.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:15.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:15.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:15.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:15.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:15.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:17.673 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:37:17.674 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:37:17.674 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:37:17.684 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:37:17.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:17.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:17.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:17.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:17.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:17.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:17.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:17.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:17.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:17.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:17.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:17.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:17.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:17.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:17.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:17.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:18.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:18.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:18.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:18.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:18.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:18.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:18.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:18.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:18.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:18.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:18.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:18.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:19.266 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:37:19.272 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:37:19.276 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454639 2023-09-23T07:37:19.276 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454639 -le 1695457101 ]] 2023-09-23T07:37:19.276 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:37:19.276 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:37:19.276 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:37:20.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:20.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:20.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:20.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:20.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:20.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:20.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:20.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:20.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:20.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:20.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:20.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:22.041 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:22.041+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:37:22.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:22.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:22.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:22.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:22.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:22.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:22.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:22.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:22.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:22.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:22.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:22.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:22.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:22.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:22.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:22.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:22.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:22.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:23.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:23.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:23.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:23.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:23.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:23.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:23.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:23.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:23.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:23.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:23.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:23.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:25.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:25.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:25.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:25.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:25.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:25.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:25.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:25.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:25.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:25.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:25.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:37:25.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:25.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:25.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:25.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:25.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:25.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:25.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:25.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:25.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:25.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:25.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:25.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:25.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:25.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:25.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:25.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:25.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:26.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:26.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:26.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:26.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:26.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:26.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:26.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:26.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:26.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:26.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:26.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:26.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:26.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:26.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:26.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:26.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:26.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:26.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:26.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:26.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:26.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:26.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:26.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:27.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:27.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:27.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:27.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:27.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:27.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:27.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:27.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:27.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:27.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:27.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:27.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:27.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:27.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:29.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:29.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:29.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:29.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:29.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:29.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:29.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:29.308 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:37:29.308 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:37:29.346 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:37:29.346 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:37:29.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:29.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:29.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:29.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:29.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:29.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:29.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:29.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:29.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:29.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:29.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:30.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:30.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:30.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:30.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:30.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:30.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:30.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:30.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:30.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:30.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:30.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:30.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:30.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:30.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:30.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:30.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:30.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:30.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:30.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:30.820 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:37:30.836 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:37:30.850 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454650 2023-09-23T07:37:30.850 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454650 -le 1695457101 ]] 2023-09-23T07:37:30.850 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:37:30.850 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:37:30.850 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:37:31.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:31.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:31.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:31.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:31.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:31.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:31.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:31.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:31.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:31.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:37:31.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:31.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:31.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:31.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:31.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:31.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:31.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:31.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:31.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:31.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:31.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:31.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:31.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:31.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:31.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:31.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:31.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:31.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:31.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:31.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:31.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:35.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:35.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:35.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:35.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:35.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:35.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:35.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:35.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:35.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:35.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:35.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:35.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:35.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:35.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:35.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:35.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:38.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:38.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:38.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:38.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:38.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:38.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:38.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:38.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:38.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:38.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:38.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:38.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:38.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:38.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:40.856 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:37:40.856 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:37:40.868 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:37:40.905 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:37:41.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:41.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:41.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:41.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:41.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:41.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:41.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:41.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:41.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:41.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:37:41.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:41.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:41.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:41.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:41.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:41.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:41.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:41.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:41.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:41.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:41.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:41.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:41.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:37:41.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:41.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:41.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:41.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:41.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:41.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:41.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:41.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:41.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:41.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:41.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:41.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:37:41.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:41.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:41.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:41.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:41.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:41.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:41.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:41.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:41.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:41.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:41.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:41.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:41.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:42.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:42.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:42.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:42.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:42.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:42.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:42.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:42.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:42.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:42.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:42.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:42.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:42.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:42.624 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:37:42.624 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:37:42.625 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454662 2023-09-23T07:37:42.625 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454662 -le 1695457101 ]] 2023-09-23T07:37:42.625 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:37:42.625 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:37:42.625 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:37:42.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:42.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:42.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:42.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:44.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:44.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:44.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:44.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:44.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:44.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:44.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:44.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:44.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:44.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:44.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:44.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:44.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:44.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:44.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:44.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:44.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:44.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:46.923 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:37:46.920+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:37:47.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:47.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:47.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:47.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:47.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:47.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:47.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:47.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:47.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:47.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:47.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:47.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:47.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:47.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:47.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:47.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:47.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:47.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:47.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:47.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:48.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:48.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:48.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:48.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:48.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:48.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:48.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:48.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:49.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:49.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:49.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:49.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:49.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:49.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:49.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:49.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:49.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:49.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:49.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:49.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:49.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:51.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:51.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:51.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:51.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:51.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:51.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:51.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:51.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:51.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:51.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:51.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:51.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:51.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:51.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:51.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:51.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:52.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:52.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:52.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:52.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:52.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:52.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:52.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:52.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:52.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:52.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:52.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:52.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:52.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:52.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:52.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:52.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:52.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:52.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:52.627 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:37:52.627 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:37:52.630 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:37:52.646 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:37:53.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:53.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:53.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:53.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:53.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:53.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:53.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:53.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:53.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:53.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:53.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:53.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:53.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:53.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:53.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:53.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:53.900 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:37:53.901 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:37:53.902 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454673 2023-09-23T07:37:53.902 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454673 -le 1695457101 ]] 2023-09-23T07:37:53.902 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:37:53.902 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:37:53.902 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:37:54.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:54.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:37:54.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:54.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:54.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:54.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:54.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:54.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:54.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:54.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:54.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:54.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:54.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:54.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:54.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:54.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:54.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:54.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:54.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:54.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:55.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:55.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:55.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:55.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:55.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:55.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:55.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:55.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:55.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:55.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:55.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:55.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:55.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:55.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:55.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:55.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:55.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:55.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:57.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:57.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:57.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:57.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:57.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:57.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:57.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:57.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:57.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:57.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:37:57.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:57.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:57.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:57.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:57.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:57.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:57.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:58.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:58.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:37:58.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:58.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:37:58.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:58.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:37:58.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:58.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:37:58.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:58.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:37:58.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:58.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:37:58.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:58.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:37:58.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:58.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:37:58.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:58.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:37:58.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:37:58.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:01.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:01.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:01.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:01.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:01.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:01.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:01.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:01.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:01.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:01.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:01.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:01.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:01.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:01.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:01.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:01.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:01.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:01.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:01.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:01.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:01.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:01.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:01.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:01.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:01.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:01.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:01.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:01.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:02.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:02.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:02.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:02.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:02.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:02.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:02.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:02.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:02.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:02.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:02.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:02.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:02.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:02.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:02.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:02.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:02.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:02.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:02.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:02.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:03.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:03.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:03.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:03.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:03.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:03.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:03.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:03.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:03.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:03.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:03.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:03.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:03.916 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:38:03.917 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:38:03.923 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:38:03.935 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:38:04.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:04.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:04.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:04.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:04.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:04.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:04.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:04.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:04.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:04.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:04.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:04.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:05.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:05.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:05.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:05.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:05.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:05.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:05.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:05.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:05.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:05.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:05.433 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:38:05.433 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:38:05.434 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454685 2023-09-23T07:38:05.434 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454685 -le 1695457101 ]] 2023-09-23T07:38:05.434 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:38:05.434 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:38:05.434 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:38:05.563 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:05.556+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:38:05.609 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:05.608+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:38:05.609 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:05.608+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:38:05.609 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:05.608+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:38:05.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:05.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:05.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:06.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:06.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:06.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:06.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:06.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:06.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:06.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:38:06.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:06.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:06.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:06.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:06.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:06.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:06.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:06.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:06.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:06.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:06.394 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:06.392+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:38:06.394 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:06.392+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:38:07.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:38:07.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:07.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:07.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:07.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:07.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:07.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:07.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:07.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:07.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:07.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:07.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:07.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:07.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:07.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:07.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:07.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:08.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:08.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:08.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:08.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:08.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:08.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:08.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:08.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:08.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:08.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:08.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:08.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:08.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:08.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:08.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:08.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:08.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:38:08.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:08.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:08.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:08.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:08.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:08.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:08.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:08.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:08.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:08.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:08.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:08.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:09.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:09.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:09.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:09.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:09.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:09.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:09.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:09.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:09.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:09.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:09.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:09.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:09.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:09.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:10.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:10.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:10.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:10.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:10.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:10.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:10.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:10.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:10.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:10.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:10.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:10.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:10.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:10.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:10.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:10.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:10.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:10.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:10.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:10.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:11.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:11.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:11.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:11.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:11.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:11.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:11.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:11.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:11.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:11.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:11.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:11.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:11.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:11.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:11.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:11.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:11.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:11.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:11.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:11.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:13.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:13.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:13.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:13.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:13.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:13.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:13.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:13.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:13.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:13.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:13.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:13.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:38:13.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:13.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:13.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:13.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:13.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:13.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:13.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:13.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:13.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:13.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:13.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:13.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:13.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:14.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:14.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:14.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:14.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:14.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:14.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:14.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:14.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:14.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:14.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:14.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:14.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:15.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:15.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:15.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:15.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:15.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:15.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:15.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:15.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:15.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:15.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:15.447 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:38:15.449 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:38:15.452 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:38:15.455 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:38:15.638 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:15.636+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:38:15.639 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:15.636+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:38:15.639 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:15.636+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:38:15.639 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:15.636+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:38:16.022 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:16.020+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:38:16.023 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:16.020+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:38:16.023 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:16.020+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:38:16.792 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:38:16.800 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:38:16.801 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454696 2023-09-23T07:38:16.801 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454696 -le 1695457101 ]] 2023-09-23T07:38:16.801 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:38:16.801 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:38:16.801 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:38:18.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:18.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:18.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:18.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:18.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:18.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:18.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:18.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:18.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:18.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:18.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:18.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:18.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:18.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:18.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:18.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:18.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:19.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:19.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:19.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:19.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:19.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:19.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:19.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:19.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:19.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:19.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:19.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:19.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:19.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:19.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:19.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:19.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:20.331 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:20.332+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:38:20.332 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:20.332+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:38:21.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:21.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:21.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:21.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:21.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:21.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:21.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:21.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:21.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:21.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:21.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:21.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:21.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:21.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:21.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:21.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:21.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:21.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:21.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:21.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:22.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:22.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:22.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:22.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:22.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:22.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:22.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:22.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:22.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:22.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:22.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:22.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:22.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:22.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:22.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:22.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:22.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:22.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:22.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:22.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:23.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:23.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:23.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:23.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:23.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:23.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:23.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:23.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:23.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:23.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:23.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:23.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:23.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:23.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:23.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:23.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:23.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:23.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:23.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:23.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:24.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:24.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:24.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:24.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:24.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:24.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:24.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:24.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:24.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:24.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:24.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:24.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:24.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:24.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:24.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:24.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:26.817 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:38:26.817 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:38:26.825 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:38:26.867 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:38:27.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:27.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:27.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:27.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:27.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:27.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:27.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:27.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:27.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:27.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:27.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:27.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:27.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:27.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:27.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:27.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:27.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:27.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:27.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:28.570 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:38:28.572 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:38:28.573 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454708 2023-09-23T07:38:28.573 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454708 -le 1695457101 ]] 2023-09-23T07:38:28.573 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:38:28.573 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:38:28.574 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:38:28.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:28.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:28.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:28.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:28.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:28.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:28.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:28.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:28.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:28.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:28.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:38:28.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:28.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:28.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:28.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:28.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:28.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:28.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:28.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:28.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:28.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:28.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:28.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:29.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:29.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:29.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:29.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:29.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:29.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:29.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:29.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:29.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:29.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:29.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:29.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:29.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:29.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:29.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:29.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:29.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:29.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:30.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:30.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:30.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:30.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:30.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:30.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:30.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:30.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:30.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:30.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:31.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:31.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:31.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:31.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:31.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:31.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:31.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:31.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:31.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:31.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:31.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:31.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:31.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:31.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:31.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:31.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:31.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:31.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:31.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:34.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:34.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:34.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:34.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:34.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:34.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:34.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:34.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:34.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:34.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:34.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:34.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:34.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:34.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:34.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:34.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:34.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:34.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:36.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:36.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:36.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:36.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:36.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:36.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:36.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:36.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:36.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:36.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:36.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:36.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:36.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:36.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:36.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:36.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:37.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:37.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:37.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:37.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:37.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:37.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:37.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:37.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:37.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:37.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:37.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:37.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:37.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:37.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:37.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:37.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:37.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:37.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:37.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:37.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:38:37.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:37.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:37.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:37.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:37.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:37.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:37.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:37.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:37.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:37.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:37.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:37.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:38.087 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:38.075+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:38:38.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:38.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:38.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:38.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:38.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:38.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:38.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:38.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:38.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:38.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:38.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:38.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:38.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:38.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:38.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:38.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:38.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:38.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:38.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:38.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:38.578 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:38:38.579 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:38:38.591 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:38:38.603 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:38:38.786 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:38.783+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:38:38.786 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:38.783+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:38:39.345 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:39.339+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:38:39.345 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:39.339+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:38:39.345 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:39.339+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:38:39.886 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:38:39.887 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:38:39.888 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454719 2023-09-23T07:38:39.888 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454719 -le 1695457101 ]] 2023-09-23T07:38:39.888 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:38:39.888 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:38:39.888 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:38:40.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:40.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:40.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:40.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:40.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:40.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:40.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:40.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:40.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:40.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:40.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:40.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:43.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:43.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:43.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:43.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:43.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:43.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:43.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:43.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:43.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:43.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:43.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:43.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:43.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:43.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:43.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:43.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:43.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:43.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:44.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:44.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:44.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:44.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:44.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:44.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:44.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:44.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:44.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:44.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:44.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:44.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:44.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:44.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:44.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:44.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:45.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:45.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:45.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:45.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:45.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:45.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:45.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:45.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:45.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:45.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:45.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:45.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:45.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:45.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:45.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:45.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:45.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:45.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:45.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:45.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:46.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:46.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:46.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:46.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:46.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:46.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:46.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:46.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:46.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:46.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:46.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:46.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:46.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:46.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:46.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:46.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:46.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:46.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:46.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:46.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:46.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:46.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:46.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:46.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:46.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:46.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:46.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:46.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:46.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:46.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:46.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:46.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:46.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:47.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:47.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:47.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:47.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:47.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:47.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:47.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:47.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:47.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:47.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:47.636 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:47.631+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:38:47.636 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:47.631+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:38:47.636 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:47.631+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:38:47.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:47.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:47.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:47.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:47.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:47.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:47.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:47.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:48.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:48.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:48.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:48.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:48.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:38:48.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:48.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:48.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:48.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:48.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:48.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:48.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:48.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:48.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:48.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:48.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:48.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:38:48.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:48.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:48.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:48.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:48.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:48.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:48.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:48.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:48.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:48.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:48.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:48.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:49.891 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:38:49.894 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:38:49.894 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:38:49.905 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:38:50.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:50.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:50.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:50.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:50.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:50.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:50.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:50.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:50.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:50.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:50.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:50.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:51.071 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:38:51.071 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:38:51.100 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454731 2023-09-23T07:38:51.101 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454731 -le 1695457101 ]] 2023-09-23T07:38:51.101 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:38:51.101 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:38:51.101 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:38:51.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:51.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:51.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:51.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:52.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:52.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:52.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:52.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:52.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:52.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:52.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:52.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:52.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:52.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:52.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:52.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:52.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:52.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:52.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:52.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:53.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:53.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:53.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:53.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:53.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:53.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:53.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:53.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:53.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:53.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:53.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:53.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:53.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:53.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:53.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:53.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:53.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:55.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:55.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:55.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:55.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:55.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:55.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:55.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:55.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:55.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:55.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:55.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:55.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:55.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:55.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:56.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:56.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:56.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:56.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:56.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:56.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:56.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:56.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:56.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:56.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:56.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:56.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:56.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:56.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:56.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:56.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:56.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:56.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:57.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:57.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:57.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:57.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:57.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:57.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:57.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:57.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:57.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:57.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:57.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:57.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:58.285 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:58.283+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:38:58.308 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:58.307+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:38:58.308 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:58.307+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:38:58.309 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:38:58.307+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:38:58.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:38:58.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:58.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:38:58.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:58.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:58.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:58.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:58.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:58.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:58.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:58.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:58.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:58.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:38:58.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:58.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:58.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:58.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:38:58.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:58.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:58.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:58.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:38:58.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:58.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:38:59.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:59.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:38:59.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:59.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:38:59.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:59.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:38:59.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:59.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:38:59.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:59.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:38:59.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:59.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:38:59.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:38:59.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:00.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:00.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:00.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:00.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:00.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:00.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:00.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:00.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:00.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:00.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:00.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:00.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:00.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:00.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:00.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:00.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:00.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:00.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:00.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:00.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:00.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:00.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:01.125 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:39:01.125 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:39:01.126 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:39:01.167 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:39:02.388 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:02.387+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:02.404 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:39:02.405 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:39:02.406 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454742 2023-09-23T07:39:02.406 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454742 -le 1695457101 ]] 2023-09-23T07:39:02.406 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:39:02.407 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:39:02.407 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:39:03.216 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:03.215+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:03.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:03.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:03.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:03.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:03.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:03.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:03.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:03.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:03.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:03.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:03.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:03.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:04.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:04.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:04.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:04.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:04.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:04.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:04.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:04.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:04.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:04.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:04.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:04.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:04.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:04.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:04.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:04.425 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:04.423+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:39:04.425 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:04.423+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:39:04.425 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:04.423+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:05.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:05.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:05.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:05.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:05.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:05.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:05.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:05.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:05.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:05.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:05.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:05.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:05.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:05.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:05.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:05.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:07.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:07.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:07.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:07.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:07.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:07.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:07.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:07.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:07.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:07.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:39:07.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:07.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:07.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:07.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:07.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:07.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:07.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:07.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:07.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:07.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:07.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:07.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:39:07.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:07.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:07.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:07.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:07.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:07.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:07.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:07.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:07.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:07.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:07.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:07.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:08.786 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:08.783+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:09.720 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:09.719+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:39:09.720 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:09.719+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:12.418 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:39:12.420 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:39:12.422 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:39:12.439 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:39:12.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:12.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:12.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:12.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:12.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:12.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:12.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:12.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:12.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:12.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:12.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:12.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:12.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:12.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:12.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:12.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:12.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:12.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:13.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:13.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:13.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:13.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:13.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:13.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:13.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:13.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:13.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:13.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:13.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:13.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:13.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:13.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:13.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:13.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:13.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:13.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:13.704 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:39:13.705 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:39:13.707 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454753 2023-09-23T07:39:13.707 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454753 -le 1695457101 ]] 2023-09-23T07:39:13.707 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:39:13.707 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:39:13.707 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:39:14.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:14.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:14.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:14.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:14.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:14.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:14.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:14.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:14.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:14.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:14.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:14.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:14.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:14.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:14.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:14.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:15.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:15.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:15.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:15.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:15.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:15.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:15.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:15.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:15.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:15.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:15.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:15.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:15.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:15.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:15.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:15.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:15.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:15.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:16.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:16.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:16.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:16.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:16.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:16.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:16.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:16.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:16.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:16.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:16.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:16.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:16.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:16.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:16.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:16.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:19.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:19.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:19.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:19.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:19.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:19.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:19.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:19.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:19.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:19.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:19.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:19.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:19.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:19.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:19.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:19.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:19.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:19.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:19.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:19.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:20.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:39:20.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:20.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:20.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:20.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:20.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:20.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:20.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:20.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:20.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:20.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:20.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:20.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:21.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:21.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:21.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:21.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:21.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:21.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:21.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:21.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:21.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:21.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:21.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:21.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:21.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:21.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:21.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:21.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:21.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:21.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:23.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:23.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:23.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:23.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:23.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:23.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:23.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:23.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:23.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:23.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:23.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:23.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:23.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:23.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:23.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:23.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:23.710 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:39:23.711 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:39:23.724 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:39:23.728 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:39:24.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:24.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:24.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:24.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:24.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:24.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:24.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:24.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:24.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:24.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:24.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:24.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:24.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:24.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:24.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:24.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:25.271 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:39:25.282 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:39:25.284 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454765 2023-09-23T07:39:25.284 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454765 -le 1695457101 ]] 2023-09-23T07:39:25.284 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:39:25.284 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:39:25.284 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:39:25.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:25.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:39:25.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:25.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:25.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:25.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:25.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:25.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:25.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:25.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:25.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:25.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:26.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:25.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:26.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:26.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:26.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:26.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:26.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:26.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:26.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:26.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:26.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:26.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:26.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:26.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:26.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:26.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:26.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:26.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:27.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:27.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:27.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:27.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:27.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:27.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:27.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:27.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:27.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:27.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:27.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:27.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:27.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:27.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:27.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:27.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:27.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:27.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:27.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:27.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:27.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:27.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:27.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:27.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:27.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:27.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:27.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:27.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:27.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:27.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:39:27.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:27.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:27.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:27.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:27.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:27.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:27.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:29.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:29.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:29.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:29.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:29.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:29.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:29.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:29.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:29.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:29.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:29.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:29.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:29.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:29.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:30.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:30.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:30.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:30.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:30.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:30.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:30.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:30.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:30.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:30.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:30.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:30.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:31.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:31.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:31.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:31.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:31.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:31.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:33.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:32.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:33.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:32.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:33.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:33.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:33.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:33.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:33.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:33.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:33.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:33.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:33.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:33.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:33.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:33.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:33.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:33.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:33.939 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:33.934+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:39:33.939 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:33.934+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:35.114 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:35.110+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:35.306 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:39:35.307 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:39:35.311 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:39:35.321 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:39:35.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:35.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:35.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:35.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:35.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:35.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:35.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:35.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:35.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:35.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:35.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:35.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:36.929 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:39:36.929 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:39:36.929 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454776 2023-09-23T07:39:36.929 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454776 -le 1695457101 ]] 2023-09-23T07:39:36.929 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:39:36.930 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:39:36.930 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:39:37.485 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:37.482+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:38.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:38.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:38.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:38.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:38.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:38.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:38.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:38.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:38.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:38.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:38.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:38.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:38.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:38.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:38.373 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:38.370+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:40.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:40.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:40.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:40.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:40.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:40.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:40.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:40.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:40.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:40.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:40.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:40.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:40.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:40.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:40.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:40.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:40.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:40.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:42.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:42.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:42.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:42.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:42.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:42.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:42.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:42.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:42.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:42.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:42.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:42.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:42.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:42.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:42.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:42.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:42.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:42.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:43.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:43.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:43.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:43.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:43.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:43.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:43.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:43.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:43.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:43.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:43.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:43.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:43.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:43.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:44.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:39:44.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:44.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:44.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:44.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:44.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:44.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:44.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:44.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:44.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:44.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:44.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:44.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:44.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:44.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:44.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:44.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:44.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:44.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:44.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:44.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:44.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:44.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:45.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:45.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:45.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:45.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:45.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:45.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:45.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:45.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:45.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:45.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:45.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:45.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:45.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:45.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:45.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:45.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:45.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:45.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:46.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:46.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:46.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:46.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:46.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:46.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:46.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:46.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:46.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:46.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:46.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:46.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:46.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:46.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:46.944 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:39:46.944 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:39:46.944 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:39:46.958 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:39:48.293 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:39:48.296 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:39:48.297 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454788 2023-09-23T07:39:48.297 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454788 -le 1695457101 ]] 2023-09-23T07:39:48.297 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:39:48.298 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:39:48.298 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:39:48.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:48.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:48.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:48.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:48.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:48.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:48.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:48.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:48.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:48.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:48.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:48.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:48.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:48.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:48.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:48.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:48.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:48.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:48.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:48.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:49.418 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:49.414+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:39:49.418 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:49.414+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:50.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:50.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:50.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:50.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:50.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:50.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:50.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:50.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:50.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:50.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:50.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:50.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:50.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:50.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:50.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:50.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:50.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:50.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:50.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:50.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:50.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:50.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:50.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:50.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:50.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:50.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:50.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:50.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:50.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:50.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:50.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:50.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:51.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:51.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:51.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:51.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:51.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:51.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:51.812 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:51.806+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:39:51.813 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:51.806+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:52.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:52.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:52.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:52.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:52.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:52.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:52.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:52.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:52.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:52.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:52.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:52.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:52.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:52.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:52.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:52.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:52.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:52.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:54.173 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:54.166+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:54.714 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:54.710+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:39:55.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:39:55.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:39:55.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:39:55.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:55.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:55.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:55.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:55.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:55.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:55.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:55.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:55.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:58.321 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:39:58.323 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:39:58.336 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:39:58.346 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:39:58.888 INFO:tasks.workunit.client.0.smithi107.stderr:2023-09-23T07:39:58.886+0000 7fbfd2ffd640 0 --2- 172.21.15.107:0/1813718784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfbc0039d0 0x7fbfcc0b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-23T07:39:59.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:59.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:39:59.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:59.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:39:59.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:59.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:39:59.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:59.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:39:59.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:59.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:39:59.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:59.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:39:59.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:59.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:39:59.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:39:59.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:39:59.709 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:59.706+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:39:59.709 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:59.706+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:39:59.709 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:39:59.706+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:40:00.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:40:00.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:00.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:00.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:40:00.234 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:40:00.235 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454800 2023-09-23T07:40:00.236 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454800 -le 1695457101 ]] 2023-09-23T07:40:00.236 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:40:00.236 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:40:00.236 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:40:00.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:00.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:00.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:00.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:00.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:00.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:00.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:00.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:00.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:00.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:02.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:02.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:02.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:02.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:02.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:02.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:02.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:02.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:02.395 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:02.390+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:40:04.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:04.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:05.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:05.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:05.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:05.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:05.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:05.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:05.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:05.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:05.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:05.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:05.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:05.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:05.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:05.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:08.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:08.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:08.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:08.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:08.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:08.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:08.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:08.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:08.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:08.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:08.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:08.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:10.247 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:40:10.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:40:10.265 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:40:10.283 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:40:11.584 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:40:11.584 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:40:11.584 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454811 2023-09-23T07:40:11.584 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454811 -le 1695457101 ]] 2023-09-23T07:40:11.585 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:40:11.585 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:40:11.585 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:40:12.245 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:12.246+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:40:12.245 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:12.246+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:40:12.446 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:12.446+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:40:13.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:13.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:13.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:13.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:13.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:13.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:13.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:13.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:13.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:13.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:13.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:13.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:16.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:16.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:16.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:16.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:16.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:16.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:16.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:16.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:16.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:16.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:16.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:16.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:17.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:17.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:17.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:17.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:17.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:17.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:17.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:17.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:17.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:17.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:17.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:17.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:17.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:17.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:19.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:19.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:19.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:19.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:19.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:19.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:19.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:19.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:19.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:19.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:19.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:19.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:19.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:19.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:19.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:19.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:19.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:19.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:19.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:19.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:20.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:20.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:20.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:20.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:20.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:20.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:20.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:20.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:20.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:20.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:20.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:20.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:20.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:20.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:20.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:20.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:20.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:20.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:21.597 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:40:21.597 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:40:21.604 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:40:21.606 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:40:22.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:22.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:22.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:22.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:22.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:22.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:22.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:22.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:22.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:22.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:22.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:22.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:40:22.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:22.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:22.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:22.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:22.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:22.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:22.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:22.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:22.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:22.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:22.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:22.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:22.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:22.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:22.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:22.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:22.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:22.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:22.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:22.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:22.851 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:40:22.858 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:40:22.860 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454822 2023-09-23T07:40:22.861 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454822 -le 1695457101 ]] 2023-09-23T07:40:22.861 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:40:22.861 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:40:22.861 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:40:22.862 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:22.861+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:40:22.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:22.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:23.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:23.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:23.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:23.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:23.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:23.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:23.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:23.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:23.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:23.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:23.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:23.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:23.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:23.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:23.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:23.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:23.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:23.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:24.243 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:24.241+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:40:24.244 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:24.241+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:40:24.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:24.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:24.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:24.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:24.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:24.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:24.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:24.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:24.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:24.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:24.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:24.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:24.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:24.559 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:24.557+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:40:24.559 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:24.557+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:40:24.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:24.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:24.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:24.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:24.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:24.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:24.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:25.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:25.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:25.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:25.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:25.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:25.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:25.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:25.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:25.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:25.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:25.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:25.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:25.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:25.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:25.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:25.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:25.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:25.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:25.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:25.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:27.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:27.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:27.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:27.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:27.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:27.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:27.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:27.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:27.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:27.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:27.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:27.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:27.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:27.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:27.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:27.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:27.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:27.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:27.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:27.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:28.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:28.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:28.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:28.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:28.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:28.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:28.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:28.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:28.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:28.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:28.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:28.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:28.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:28.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:28.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:28.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:29.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:29.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:29.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:29.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:29.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:29.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:29.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:29.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:29.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:29.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:29.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:29.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:29.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:29.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:29.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:29.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:29.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:29.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:31.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:31.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:31.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:31.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:31.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:31.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:31.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:31.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:31.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:31.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:31.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:31.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:31.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:31.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:32.862 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:40:32.863 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:40:32.866 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:40:32.877 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:40:33.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:33.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:33.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:33.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:33.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:33.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:33.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:33.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:33.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:33.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:33.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:33.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:33.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:33.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:33.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:33.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:34.209 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:40:34.209 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:40:34.209 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454834 2023-09-23T07:40:34.210 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454834 -le 1695457101 ]] 2023-09-23T07:40:34.210 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:40:34.210 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:40:34.210 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:40:34.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:34.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:34.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:34.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:34.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:34.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:34.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:34.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:34.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:34.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:34.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:34.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:36.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:36.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:36.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:36.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:36.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:36.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:36.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:36.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:36.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:36.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:36.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:36.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:36.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:36.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:36.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:36.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:36.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:36.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:36.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:36.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:38.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:38.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:38.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:38.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:38.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:38.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:38.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:38.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:38.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:38.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:38.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:38.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:38.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:38.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:38.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:38.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:38.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:38.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:38.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:38.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:38.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:38.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:38.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:38.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:38.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:38.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:38.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:38.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:38.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:38.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:38.972 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:38.965+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:40:38.972 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:38.965+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:40:38.972 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:38.965+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:40:38.972 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:38.969+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:40:38.973 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:38.969+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:40:38.973 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:38.969+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:40:39.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:39.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:39.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:39.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:39.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:39.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:39.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:39.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:39.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:39.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:39.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:39.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:39.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:39.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:40.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:40.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:40.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:40.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:40.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:40.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:40.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:40.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:40.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:40.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:40.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:40.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:41.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:42.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:42.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:42.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:42.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:42.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:42.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:42.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:42.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:42.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:41.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:43.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:43.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:43.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:43.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:43.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:43.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:43.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:43.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:43.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:43.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:43.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:43.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:43.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:43.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:44.221 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:40:44.221 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:40:44.230 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:40:44.233 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:40:45.467 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:40:45.468 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:40:45.468 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454845 2023-09-23T07:40:45.468 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454845 -le 1695457101 ]] 2023-09-23T07:40:45.468 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:40:45.468 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:40:45.468 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:40:46.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:46.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:46.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:46.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:46.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:46.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:46.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:46.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:46.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:46.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:46.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:46.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:46.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:46.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:47.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:47.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:47.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:47.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:47.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:47.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:47.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:47.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:47.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:47.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:47.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:47.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:47.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:48.230 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:48.229+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:40:50.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:40:50.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:50.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:50.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:50.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:50.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:50.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:50.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:50.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:50.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:50.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:50.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:50.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:50.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:50.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:50.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:51.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:51.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:51.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:51.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:51.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:51.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:51.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:51.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:51.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:51.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:51.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:51.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:52.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:52.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:52.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:52.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:52.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:52.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:52.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:52.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:52.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:52.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:52.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:52.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:52.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:52.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:52.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:52.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:53.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:40:53.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:53.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:53.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:53.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:53.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:53.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:53.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:53.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:53.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:53.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:40:53.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:40:53.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:40:53.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:40:53.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:40:53.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:40:53.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:40:53.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:40:53.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:40:53.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:40:53.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:40:55.102 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:55.101+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:40:55.102 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:55.101+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:40:55.474 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:40:55.475 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:40:55.477 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:40:55.484 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:40:56.874 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:40:56.874 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:40:56.875 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454856 2023-09-23T07:40:56.875 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454856 -le 1695457101 ]] 2023-09-23T07:40:56.875 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:40:56.875 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:40:56.875 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:40:57.009 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:40:57.009+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:41:00.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:00.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:00.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:00.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:00.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:00.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:00.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:00.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:00.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:00.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:00.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:00.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:00.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:00.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:00.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:00.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:00.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:00.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:00.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:00.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:00.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:00.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:00.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:00.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:00.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:00.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:00.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:00.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:01.098 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:01.097+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:41:01.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:01.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:01.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:01.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:01.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:01.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:01.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:01.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:01.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:01.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:01.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:01.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:01.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:01.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:01.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:01.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:01.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:01.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:01.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:01.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:05.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:05.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:05.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:05.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:05.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:05.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:05.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:05.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:05.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:05.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:05.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:05.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:05.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:05.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:06.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:06.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:06.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:06.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:41:06.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:06.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:06.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:06.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:06.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:06.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:06.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:06.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:06.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:06.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:06.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:06.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:06.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:06.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:06.889 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:41:06.890 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:41:06.892 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:41:06.895 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:41:07.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:07.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:07.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:07.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:07.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:07.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:07.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:07.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:07.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:07.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:07.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:07.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:07.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:07.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:07.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:07.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:07.645 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:07.645+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:41:07.645 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:07.645+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:41:07.645 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:07.645+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:41:07.663 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:07.661+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:41:08.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:08.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:08.178 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:41:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:41:08.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454868 2023-09-23T07:41:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454868 -le 1695457101 ]] 2023-09-23T07:41:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:41:08.181 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:41:08.181 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:41:08.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:08.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:08.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:08.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:08.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:08.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:08.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:08.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:08.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:08.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:08.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:08.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:08.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:08.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:08.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:08.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:09.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:09.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:09.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:09.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:09.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:09.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:09.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:09.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:09.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:09.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:09.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:09.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:09.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:09.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:09.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:09.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:09.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:09.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:09.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:09.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:09.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:09.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:10.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:10.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:10.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:10.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:10.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:10.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:10.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:10.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:10.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:10.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:10.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:10.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:10.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:10.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:11.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:11.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:11.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:11.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:11.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:11.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:11.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:11.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:11.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:11.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:11.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:11.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:12.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:12.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:12.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:12.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:12.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:12.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:12.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:12.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:12.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:12.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:12.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:12.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:12.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:12.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:12.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:12.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:12.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:12.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:12.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:12.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:12.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:12.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:12.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:12.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:12.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:12.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:12.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:12.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:12.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:12.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:13.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:13.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:13.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:13.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:13.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:13.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:13.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:13.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:13.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:13.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:13.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:13.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:13.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:13.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:13.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:13.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:13.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:13.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:14.142 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:14.141+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:41:14.142 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:14.141+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:41:14.154 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:14.153+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:41:14.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:14.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:14.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:14.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:14.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:14.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:14.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:14.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:14.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:14.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:14.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:14.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:14.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:14.738 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:14.737+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:41:14.738 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:14.737+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:41:14.738 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:14.737+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:41:14.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:14.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:15.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:15.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:15.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:15.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:15.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:15.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:15.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:15.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:15.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:15.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:15.636 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:15.633+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:41:15.636 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:15.633+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:41:15.636 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:15.633+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:41:15.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:15.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:15.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:15.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:15.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:15.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:15.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:15.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:15.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:15.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:17.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:17.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:17.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:17.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:17.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:17.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:17.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:17.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:17.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:17.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:17.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:17.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:17.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:17.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:17.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:17.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:18.186 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:41:18.190 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:41:18.190 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:41:18.190 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:41:19.427 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:41:19.450 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:41:19.451 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454879 2023-09-23T07:41:19.451 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454879 -le 1695457101 ]] 2023-09-23T07:41:19.451 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:41:19.452 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:41:19.452 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:41:19.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:19.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:19.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:19.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:19.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:19.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:19.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:19.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:19.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:19.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:19.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:19.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:19.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:19.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:19.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:19.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:19.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:19.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:20.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:20.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:20.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:20.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:20.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:20.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:20.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:20.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:20.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:20.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:20.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:20.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:20.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:20.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:20.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:20.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:20.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:20.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:20.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:20.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:20.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:20.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:20.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:20.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:21.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:21.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:21.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:41:21.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:21.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:21.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:21.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:21.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:21.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:21.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:21.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:21.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:21.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:21.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:21.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:21.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:21.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:21.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:21.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:21.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:21.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:22.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:22.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:22.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:22.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:22.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:22.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:22.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:22.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:22.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:22.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:22.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:22.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:22.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:22.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:22.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:22.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:22.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:22.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:22.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:22.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:41:22.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:22.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:22.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:22.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:22.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:22.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:22.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:22.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:41:22.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:22.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:22.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:22.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:22.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:22.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:22.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:22.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:22.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:22.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:22.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:25.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:25.620 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:25.608+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:41:25.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:25.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:25.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:25.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:25.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:25.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:25.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:25.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:25.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:25.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:25.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:25.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:25.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:27.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:27.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:27.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:27.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:27.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:27.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:27.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:27.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:27.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:27.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:27.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:41:27.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:27.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:27.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:27.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:27.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:27.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:27.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:28.264 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:28.256+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:41:28.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:28.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:28.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:28.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:28.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:28.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:28.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:28.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:28.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:28.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:28.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:41:28.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:28.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:28.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:28.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:28.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:28.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:28.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:28.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:28.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:28.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:28.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:28.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:29.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:29.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:29.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:29.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:29.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:29.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:29.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:29.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:29.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:29.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:29.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:29.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:29.483 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:41:29.489 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:41:29.497 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:41:29.507 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:41:30.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:30.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:41:30.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:30.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:30.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:30.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:30.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:30.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:30.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:30.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:30.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:30.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:30.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:30.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:30.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:30.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:30.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:30.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:30.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:30.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:30.745 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:41:30.765 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:41:30.766 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454890 2023-09-23T07:41:30.766 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454890 -le 1695457101 ]] 2023-09-23T07:41:30.766 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:41:30.766 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:41:30.766 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:41:31.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:41:31.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:31.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:31.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:31.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:31.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:31.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:31.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:31.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:31.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:31.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:31.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:31.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:31.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:31.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:31.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:31.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:31.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:31.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:31.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:31.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:31.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:33.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:33.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:33.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:33.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:33.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:33.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:33.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:33.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:33.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:33.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:33.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:33.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:33.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:33.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:33.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:33.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:33.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:33.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:34.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:34.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:34.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:34.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:34.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:34.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:34.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:34.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:34.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:34.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:34.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:41:34.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:34.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:34.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:34.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:34.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:34.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:34.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:34.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:34.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:34.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:34.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:34.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:34.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:34.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:34.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:34.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:34.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:34.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:35.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:35.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:35.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:35.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:35.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:35.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:35.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:35.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:35.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:35.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:35.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:35.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:35.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:35.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:35.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:35.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:35.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:35.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:35.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:35.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:36.810 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:36.808+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:41:36.817 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:36.808+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:41:36.817 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:36.808+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:41:37.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:37.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:37.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:37.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:37.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:37.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:37.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:37.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:37.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:37.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:37.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:37.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:37.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:37.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:37.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:37.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:37.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:37.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:37.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:37.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:38.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:38.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:38.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:38.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:38.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:38.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:38.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:38.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:38.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:38.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:38.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:38.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:38.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:38.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:38.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:38.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:38.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:38.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:38.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:38.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:39.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:39.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:39.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:39.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:39.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:39.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:39.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:39.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:39.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:39.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:39.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:39.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:39.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:39.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:39.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:39.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:39.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:39.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:39.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:39.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:39.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:39.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:39.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:40.747 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:41:40.748 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:41:40.748 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:41:40.748 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:41:41.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:41.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:41.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:41.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:41.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:41.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:41.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:41.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:41.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:41.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:41.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:41.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:41.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:41.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:41.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:41.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:41.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:41.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:41.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:41.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:41.957 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:41:41.964 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:41:41.967 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454901 2023-09-23T07:41:41.967 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454901 -le 1695457101 ]] 2023-09-23T07:41:41.967 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:41:41.967 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:41:41.967 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:41:42.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:42.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:42.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:42.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:42.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:42.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:42.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:42.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:42.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:42.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:42.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:42.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:43.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:43.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:43.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:43.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:43.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:43.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:43.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:43.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:43.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:43.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:44.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:44.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:44.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:44.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:44.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:44.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:44.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:44.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:46.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:46.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:46.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:46.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:46.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:46.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:46.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:46.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:46.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:46.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:46.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:46.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:46.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:46.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:46.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:46.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:47.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:47.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:47.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:47.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:47.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:47.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:47.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:47.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:47.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:47.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:47.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:47.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:47.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:47.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:47.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:47.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:47.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:47.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:48.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:48.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:48.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:48.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:48.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:48.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:48.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:48.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:48.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:48.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:48.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:48.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:48.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:48.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:48.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:48.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:48.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:49.128 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:49.124+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:41:49.141 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:41:49.140+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:41:51.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:51.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:51.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:51.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:51.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:51.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:51.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:51.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:51.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:51.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:51.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:51.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:51.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:51.972 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:41:51.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:51.981 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:41:51.988 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:41:51.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:51.992 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:41:51.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:51.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:51.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:51.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:51.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:51.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:51.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:52.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:52.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:52.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:52.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:52.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:52.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:52.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:52.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:52.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:52.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:52.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:52.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:52.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:52.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:52.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:52.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:52.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:52.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:53.348 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:41:53.366 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:41:53.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454913 2023-09-23T07:41:53.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454913 -le 1695457101 ]] 2023-09-23T07:41:53.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:41:53.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:41:53.370 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:41:54.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:54.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:54.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:54.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:55.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:55.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:55.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:55.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:55.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:55.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:55.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:55.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:55.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:55.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:55.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:55.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:55.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:55.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:55.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:55.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:56.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:56.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:56.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:56.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:56.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:56.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:56.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:56.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:56.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:56.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:56.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:56.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:41:56.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:56.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:56.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:56.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:56.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:56.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:56.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:56.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:56.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:56.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:56.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:56.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:57.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:57.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:57.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:57.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:57.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:57.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:57.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:57.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:57.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:57.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:57.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:57.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:57.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:57.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:57.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:57.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:57.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:57.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:58.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:58.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:41:58.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:58.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:58.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:58.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:58.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:58.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:58.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:58.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:58.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:58.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:58.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:58.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:58.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:58.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:58.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:58.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:58.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:58.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:41:59.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:59.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:41:59.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:59.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:41:59.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:59.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:41:59.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:59.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:41:59.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:59.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:41:59.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:59.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:41:59.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:59.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:41:59.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:59.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:41:59.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:59.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:41:59.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:41:59.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:00.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:00.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:00.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:00.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:00.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:00.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:00.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:00.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:00.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:00.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:00.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:00.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:00.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:00.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:00.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:00.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:00.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:01.815 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:01.812+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:42:01.815 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:01.812+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:42:01.826 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:01.824+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:42:01.826 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:01.824+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:42:01.827 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:01.824+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:42:02.265 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:42:02.264+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T07:42:02.265 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:42:02.264+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:42:02.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:02.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:02.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:02.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:02.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:02.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:02.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:02.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:02.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:02.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:02.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:02.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:03.377 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:42:03.377 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:42:03.378 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:42:03.380 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:42:04.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:04.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:04.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:04.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:04.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:04.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:04.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:04.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:04.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:04.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:04.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:04.778 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:42:04.782 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:42:04.783 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454924 2023-09-23T07:42:04.783 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454924 -le 1695457101 ]] 2023-09-23T07:42:04.783 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:42:04.783 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:42:04.784 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:42:05.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:05.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:05.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:05.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:05.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:05.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:05.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:05.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:05.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:05.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:05.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:05.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:05.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:05.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:06.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:06.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:06.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:06.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:06.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:06.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:06.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:07.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:07.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:07.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:07.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:07.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:07.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:07.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:07.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:07.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:07.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:07.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:07.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:07.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:07.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:07.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:07.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:07.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:07.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:07.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:07.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:08.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:08.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:08.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:08.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:08.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:08.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:08.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:08.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:08.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:08.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:08.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:08.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:08.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:08.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:08.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:08.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:08.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:08.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:08.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:08.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:08.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:08.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:08.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:08.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:08.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:11.023 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:11.020+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:42:13.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:13.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:13.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:13.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:13.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:13.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:13.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:13.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:13.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:13.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:13.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:13.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:14.786 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:42:14.796 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:42:14.801 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:42:14.810 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:42:15.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:15.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:15.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:15.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:15.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:15.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:15.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:15.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:15.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:15.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:15.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:15.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:15.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:15.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:15.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:16.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:16.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:16.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:16.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:16.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:16.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:16.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:16.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:16.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:16.219 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:42:16.220 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:42:16.229 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454936 2023-09-23T07:42:16.229 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454936 -le 1695457101 ]] 2023-09-23T07:42:16.229 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:42:16.229 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:42:16.229 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:42:16.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:16.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:16.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:16.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:16.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:16.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:16.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:16.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:18.628 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:18.624+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:42:18.628 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:18.624+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:42:18.628 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:18.624+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:42:19.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:19.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:19.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:19.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:19.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:19.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:19.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:19.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:19.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:19.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:19.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:19.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:19.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:19.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:19.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:19.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:19.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:19.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:19.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:19.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:20.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:20.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:20.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:20.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:20.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:20.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:20.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:20.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:20.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:20.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:20.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:20.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:22.468 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:22.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:42:22.468 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:22.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:42:22.469 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:22.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:42:26.228 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:42:26.235 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:42:26.236 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:42:26.241 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:42:27.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:27.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:27.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:27.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:27.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:27.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:27.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:27.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:27.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:27.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:42:27.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:27.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:27.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:27.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:27.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:27.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:27.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:27.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:27.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:27.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:27.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:27.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:42:27.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:27.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:27.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:27.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:27.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:27.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:27.612 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:42:27.612 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:42:27.613 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454947 2023-09-23T07:42:27.613 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454947 -le 1695457101 ]] 2023-09-23T07:42:27.613 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:42:27.613 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:42:27.614 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:42:27.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:27.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:27.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:27.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:27.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:27.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:28.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:28.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:28.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:28.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:28.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:28.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:28.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:28.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:28.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:28.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:28.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:28.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:28.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:28.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:30.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:30.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:30.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:30.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:30.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:30.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:30.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:30.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:30.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:30.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:30.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:30.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:30.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:30.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:30.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:33.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:33.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:33.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:33.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:33.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:33.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:33.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:33.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:33.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:33.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:33.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:33.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:33.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:33.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:33.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:33.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:34.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:34.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:34.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:34.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:34.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:34.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:34.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:34.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:34.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:34.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:34.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:34.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:34.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:34.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:34.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:34.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:34.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:34.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:35.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:35.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:35.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:35.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:35.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:35.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:35.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:35.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:35.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:35.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:35.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:35.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:35.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:35.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:35.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:35.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:35.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:35.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:37.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:37.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:37.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:37.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:37.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:37.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:37.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:37.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:37.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:37.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:42:37.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:37.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:37.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:37.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:37.620 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:42:37.627 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:42:37.627 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:42:37.633 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:42:37.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:37.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:37.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:37.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:37.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:37.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:37.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:37.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:37.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:37.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:37.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:37.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:37.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:37.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:37.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:37.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:38.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:42:38.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:38.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:38.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:38.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:38.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:38.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:38.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:38.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:38.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:38.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:38.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:38.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:39.105 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:42:39.106 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:42:39.107 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454959 2023-09-23T07:42:39.107 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454959 -le 1695457101 ]] 2023-09-23T07:42:39.107 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:42:39.107 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:42:39.107 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:42:40.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:40.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:40.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:40.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:40.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:40.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:40.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:40.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:40.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:40.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:40.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:40.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:42:40.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:40.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:40.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:40.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:40.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:40.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:40.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:40.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:40.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:40.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:40.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:40.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:41.077 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:41.075+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:42:41.078 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:41.075+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:42:41.078 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:41.075+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:42:41.724 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:41.719+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:42:41.724 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:42:41.719+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:42:42.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:42.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:42.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:42.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:42.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:42.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:42.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:42.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:42.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:42.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:42.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:42.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:45.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:45.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:45.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:45.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:45.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:45.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:46.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:45.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:46.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:46.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:46.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:46.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:46.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:46.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:46.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:46.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:46.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:46.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:48.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:48.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:48.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:48.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:48.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:48.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:48.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:48.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:48.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:48.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:48.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:48.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:48.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:48.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:48.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:48.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:48.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:48.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:48.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:48.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:48.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:49.125 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:42:49.127 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:42:49.129 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:42:49.129 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:42:49.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:49.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:49.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:49.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:49.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:49.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:49.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:49.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:49.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:49.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:49.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:49.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:49.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:49.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:49.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:49.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:50.367 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:42:50.367 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:42:50.367 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454970 2023-09-23T07:42:50.368 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454970 -le 1695457101 ]] 2023-09-23T07:42:50.368 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:42:50.368 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:42:50.368 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:42:50.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:50.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:50.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:50.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:50.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:50.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:50.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:50.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:50.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:50.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:50.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:50.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:52.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:52.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:52.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:52.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:52.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:52.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:52.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:52.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:52.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:52.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:52.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:52.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:52.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:52.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:53.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:53.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:53.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:53.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:53.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:42:53.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:53.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:53.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:53.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:53.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:53.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:53.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:53.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:53.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:53.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:54.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:54.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:54.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:54.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:54.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:54.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:54.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:54.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:54.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:54.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:54.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:54.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:54.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:54.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:54.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:54.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:54.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:54.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:54.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:54.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:55.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:55.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:55.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:55.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:55.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:55.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:55.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:55.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:55.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:55.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:55.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:55.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:55.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:55.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:55.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:55.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:55.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:55.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:58.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:58.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:42:58.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:58.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:58.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:58.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:58.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:58.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:58.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:58.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:58.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:58.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:58.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:58.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:58.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:58.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:58.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:58.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:58.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:58.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:59.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:59.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:59.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:59.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:59.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:59.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:42:59.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:42:59.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:42:59.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:42:59.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:42:59.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:42:59.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:42:59.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:42:59.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:42:59.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:42:59.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:00.373 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:43:00.379 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:43:00.380 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:43:00.381 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:43:01.701 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:43:01.703 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:43:01.710 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454981 2023-09-23T07:43:01.710 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454981 -le 1695457101 ]] 2023-09-23T07:43:01.710 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:43:01.710 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:43:01.710 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:43:03.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:03.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:03.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:03.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:03.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:03.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:03.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:03.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:03.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:03.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:03.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:03.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:03.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:03.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:03.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:03.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:04.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:04.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:04.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:04.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:04.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:04.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:04.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:04.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:04.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:43:04.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:04.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:04.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:04.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:04.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:07.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:07.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:07.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:07.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:07.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:07.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:07.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:07.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:07.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:07.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:07.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:07.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:07.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:07.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:07.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:07.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:07.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:07.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:07.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:07.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:07.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:07.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:08.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:08.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:08.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:08.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:08.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:08.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:08.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:08.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:08.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:08.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:08.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:08.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:08.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:08.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:08.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:08.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:08.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:08.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:08.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:08.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:08.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:10.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:10.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:10.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:10.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:10.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:10.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:10.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:10.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:10.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:10.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:10.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:10.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:11.717 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:43:11.722 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:43:11.724 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:43:11.725 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:43:12.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:12.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:12.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:12.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:12.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:12.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:12.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:12.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:12.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:12.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:12.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:12.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:12.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:12.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:12.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:12.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:12.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:12.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:12.936 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:43:12.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:43:12.944 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695454992 2023-09-23T07:43:12.944 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695454992 -le 1695457101 ]] 2023-09-23T07:43:12.944 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:43:12.945 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:43:12.945 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:43:13.101 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:13.099+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:43:13.101 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:13.099+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:43:14.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:14.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:14.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:14.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:15.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:15.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:15.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:15.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:15.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:15.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:15.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:15.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:15.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:15.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:15.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:15.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:15.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:15.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:15.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:15.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:15.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:15.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:17.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:17.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:17.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:17.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:17.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:17.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:17.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:17.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:17.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:17.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:17.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:17.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:18.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:18.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:18.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:18.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:18.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:18.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:18.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:18.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:18.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:18.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:18.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:18.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:18.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:18.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:18.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:18.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:18.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:18.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:18.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:18.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:18.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:18.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:18.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:18.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:18.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:21.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:21.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:21.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:21.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:21.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:21.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:21.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:21.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:21.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:21.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:21.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:21.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:21.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:21.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:21.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:21.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:22.418 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:22.415+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:43:22.419 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:22.415+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:43:22.957 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:43:22.957 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:43:22.958 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:43:22.961 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:43:23.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:23.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:23.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:23.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:23.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:23.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:23.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:23.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:23.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:23.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:23.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:23.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:23.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:23.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:23.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:23.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:23.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:23.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:23.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:23.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:24.320 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:43:24.321 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:43:24.321 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455004 2023-09-23T07:43:24.321 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455004 -le 1695457101 ]] 2023-09-23T07:43:24.322 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:43:24.322 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:43:24.322 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:43:24.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:24.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:24.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:24.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:24.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:24.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:24.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:24.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:24.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:24.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:24.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:24.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:24.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:24.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:24.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:24.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:25.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:25.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:25.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:25.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:25.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:25.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:25.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:25.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:25.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:25.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:25.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:25.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:25.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:25.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:26.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:26.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:26.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:26.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:26.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:26.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:26.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:26.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:26.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:26.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:26.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:26.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:26.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:26.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:26.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:26.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:26.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:26.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:26.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:26.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:28.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:28.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:28.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:28.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:28.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:28.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:28.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:28.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:28.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:28.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:28.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:28.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:43:28.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:28.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:28.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:28.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:28.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:28.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:28.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:28.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:28.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:28.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:28.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:28.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:28.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:28.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:28.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:28.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:28.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:28.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:28.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:28.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:28.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:32.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:32.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:32.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:32.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:32.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:32.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:32.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:32.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:32.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:32.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:32.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:32.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:32.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:32.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:32.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:32.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:32.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:32.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:34.325 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:43:34.326 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:43:34.328 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:43:34.345 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:43:35.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:35.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:35.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:35.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:35.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:35.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:35.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:35.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:35.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:35.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:35.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:35.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:35.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:35.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:35.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:35.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:35.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:35.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:35.633 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:43:35.634 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:43:35.634 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455015 2023-09-23T07:43:35.634 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455015 -le 1695457101 ]] 2023-09-23T07:43:35.634 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:43:35.635 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:43:35.635 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:43:36.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:43:36.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:36.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:36.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:36.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:36.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:36.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:36.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:36.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:36.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:43:36.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:36.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:36.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:36.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:36.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:36.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:36.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:36.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:36.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:37.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:37.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:37.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:37.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:37.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:37.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:37.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:37.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:37.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:37.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:37.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:37.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:37.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:37.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:37.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:37.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:37.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:37.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:39.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:39.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:39.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:39.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:39.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:39.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:39.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:39.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:39.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:39.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:39.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:39.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:39.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:39.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:39.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:39.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:39.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:39.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:39.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:39.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:41.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:41.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:41.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:41.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:41.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:41.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:41.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:41.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:41.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:41.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:41.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:41.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:41.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:41.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:41.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:41.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:41.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:41.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:41.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:42.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:42.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:42.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:42.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:42.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:42.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:42.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:42.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:42.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:42.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:42.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:42.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:43.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:43.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:43.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:43.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:43.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:43.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:43.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:43.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:43.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:43.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:43.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:43.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:43.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:43.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:43.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:43.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:43.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:43.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:43.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:43.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:45.637 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:43:45.637 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:43:45.646 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:43:45.674 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:43:46.813 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:43:46.814 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:43:46.814 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455026 2023-09-23T07:43:46.814 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455026 -le 1695457101 ]] 2023-09-23T07:43:46.814 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:43:46.814 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:43:46.815 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:43:48.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:48.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:48.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:48.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:48.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:48.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:48.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:48.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:48.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:48.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:48.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:48.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:48.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:48.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:48.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:48.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:48.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:48.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:48.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:48.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:48.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:48.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:48.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:48.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:48.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:49.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:49.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:49.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:49.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:49.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:49.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:49.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:49.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:49.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:49.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:49.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:49.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:49.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:49.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:49.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:49.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:49.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:49.340 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:49.338+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:43:49.340 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:49.338+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:43:49.340 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:49.338+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:43:49.992 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:49.986+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:43:50.268 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:50.266+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:43:50.667 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:50.658+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:43:50.667 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:50.658+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:43:51.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:51.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:51.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:51.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:51.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:51.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:51.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:51.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:51.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:51.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:43:51.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:51.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:51.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:51.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:51.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:51.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:51.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:51.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:51.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:51.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:51.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:52.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:52.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:52.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:52.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:52.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:52.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:52.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:52.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:52.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:52.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:52.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:52.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:52.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:52.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:54.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:54.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:54.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:54.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:54.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:54.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:54.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:54.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:54.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:54.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:54.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:54.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:54.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:54.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:54.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:54.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:54.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:54.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:54.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:54.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:55.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:55.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:55.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:55.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:55.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:55.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:55.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:55.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:55.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:55.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:55.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:55.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:55.859 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:43:55.854+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:43:55.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:55.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:55.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:55.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:55.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:55.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:55.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:55.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:56.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:56.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:56.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:56.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:56.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:56.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:56.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:56.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:56.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:56.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:56.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:43:56.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:56.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:56.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:56.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:56.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:56.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:56.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:56.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:56.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:56.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:56.816 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:43:56.816 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:43:56.818 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:43:56.828 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:43:57.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:57.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:43:57.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:57.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:43:57.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:57.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:43:57.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:57.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:43:57.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:57.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:43:57.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:57.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:43:57.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:57.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:43:57.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:57.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:43:57.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:57.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:43:57.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:43:57.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:43:58.153 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:43:58.155 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:43:58.156 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455038 2023-09-23T07:43:58.156 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455038 -le 1695457101 ]] 2023-09-23T07:43:58.156 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:43:58.156 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:43:58.157 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:44:00.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:00.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:00.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:00.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:01.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:01.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:01.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:01.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:01.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:01.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:01.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:01.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:01.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:01.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:01.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:01.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:01.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:01.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:01.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:01.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:01.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:02.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:02.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:02.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:02.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:02.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:02.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:02.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:02.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:02.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:02.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:02.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:02.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:02.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:02.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:02.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:02.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:02.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:02.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:02.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:02.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:04.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:04.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:04.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:04.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:04.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:04.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:04.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:04.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:04.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:04.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:04.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:04.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:04.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:04.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:04.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:04.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:04.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:04.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:05.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:44:05.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:05.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:05.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:05.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:05.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:05.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:05.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:05.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:05.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:05.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:05.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:05.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:05.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:05.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:05.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:05.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:05.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:05.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:05.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:05.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:05.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:05.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:05.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:05.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:05.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:05.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:06.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:06.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:06.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:06.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:06.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:06.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:06.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:06.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:06.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:06.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:06.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:06.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:06.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:06.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:06.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:06.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:06.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:06.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:06.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:06.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:06.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:06.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:06.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:06.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:06.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:07.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:07.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:07.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:07.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:07.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:07.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:07.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:07.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:08.162 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:44:08.163 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:44:08.170 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:44:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:44:08.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:08.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:08.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:08.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:08.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:08.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:08.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:08.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:08.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:08.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:08.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:08.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:08.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:08.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:08.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:08.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:08.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:08.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:09.391 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:44:09.391 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:44:09.392 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455049 2023-09-23T07:44:09.392 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455049 -le 1695457101 ]] 2023-09-23T07:44:09.392 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:44:09.392 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:44:09.392 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:44:11.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:11.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:11.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:11.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:11.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:11.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:11.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:11.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:11.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:11.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:11.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:11.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:11.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:11.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:11.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:11.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:11.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:11.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:11.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:11.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:14.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:14.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:14.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:14.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:14.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:14.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:14.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:14.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:14.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:14.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:14.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:14.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:14.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:14.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:14.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:14.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:14.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:14.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:14.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:14.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:14.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:14.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:15.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:15.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:15.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:15.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:15.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:15.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:15.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:15.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:15.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:15.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:15.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:15.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:15.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:15.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:15.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:15.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:15.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:15.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:15.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:15.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:15.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:16.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:16.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:16.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:16.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:16.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:16.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:16.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:16.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:16.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:16.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:16.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:16.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:16.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:16.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:16.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:16.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:17.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:17.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:17.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:17.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:17.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:17.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:17.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:17.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:17.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:17.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:17.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:17.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:17.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:17.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:17.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:17.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:17.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:17.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:17.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:17.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:17.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:17.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:18.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:18.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:18.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:18.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:18.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:18.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:18.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:18.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:18.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:18.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:18.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:18.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:19.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:19.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:19.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:19.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:19.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:19.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:19.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:19.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:19.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:19.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:19.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:19.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:19.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:19.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:19.393 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:44:19.394 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:44:19.396 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:44:19.411 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:44:20.742 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:44:20.742 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:44:20.743 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455060 2023-09-23T07:44:20.743 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455060 -le 1695457101 ]] 2023-09-23T07:44:20.743 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:44:20.743 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:44:20.743 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:44:22.484 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:44:22.482+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:44:22.484 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:44:22.482+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:44:23.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:23.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:23.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:23.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:23.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:23.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:23.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:23.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:23.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:23.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:23.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:23.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:23.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:23.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:23.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:23.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:25.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:25.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:25.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:25.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:25.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:25.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:25.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:25.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:25.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:25.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:25.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:25.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:27.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:27.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:27.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:27.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:27.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:27.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:27.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:27.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:27.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:27.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:27.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:27.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:27.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:27.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:27.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:27.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:27.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:27.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:27.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:28.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:28.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:28.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:28.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:28.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:28.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:28.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:28.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:28.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:28.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:28.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:28.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:28.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:28.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:28.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:28.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:28.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:28.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:28.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:28.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:28.644 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:44:28.646+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:44:28.645 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:44:28.646+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:44:30.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:30.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:30.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:30.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:30.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:30.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:30.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:30.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:30.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:30.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:30.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:30.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:30.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:30.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:30.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:30.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:30.747 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:44:30.750 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:44:30.750 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:44:30.772 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:44:31.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:31.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:31.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:31.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:31.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:31.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:31.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:31.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:31.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:31.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:31.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:31.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:31.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:31.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:31.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:31.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:32.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:32.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:32.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:32.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:32.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:32.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:32.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:32.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:32.419 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:44:32.419 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:44:32.420 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455072 2023-09-23T07:44:32.420 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455072 -le 1695457101 ]] 2023-09-23T07:44:32.420 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:44:32.420 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:44:32.420 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:44:32.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:32.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:32.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:32.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:32.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:32.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:32.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:32.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:32.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:32.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:32.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:35.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:44:35.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:35.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:35.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:35.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:35.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:35.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:35.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:35.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:35.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:35.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:35.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:35.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:36.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:44:36.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:36.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:36.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:36.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:36.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:36.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:36.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:36.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:36.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:36.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:36.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:37.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:37.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:37.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:37.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:37.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:37.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:37.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:37.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:37.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:37.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:37.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:37.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:37.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:37.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:37.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:37.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:37.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:37.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:39.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:39.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:39.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:39.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:39.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:39.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:39.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:39.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:39.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:39.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:39.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:39.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:39.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:40.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:40.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:40.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:40.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:40.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:40.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:40.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:40.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:40.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:40.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:40.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:40.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:40.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:40.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:42.428 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:44:42.428 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:44:42.438 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:44:42.452 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:44:42.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:42.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:42.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:42.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:42.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:42.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:42.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:42.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:42.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:42.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:42.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:42.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:42.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:42.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:42.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:42.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:43.781 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:44:43.781 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:44:43.782 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455083 2023-09-23T07:44:43.782 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455083 -le 1695457101 ]] 2023-09-23T07:44:43.782 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:44:43.782 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:44:43.782 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:44:46.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:46.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:46.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:46.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:46.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:46.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:46.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:46.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:46.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:46.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:46.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:46.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:48.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:48.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:48.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:48.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:48.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:48.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:48.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:48.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:48.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:48.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:48.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:48.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:48.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:48.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:48.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:48.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:49.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:49.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:49.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:49.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:49.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:49.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:49.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:49.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:49.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:49.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:49.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:49.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:49.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:49.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:49.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:49.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:52.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:52.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:53.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:53.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:44:53.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:53.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:53.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:53.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:53.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:53.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:53.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:53.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:53.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:53.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:53.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:53.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:53.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:53.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:53.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:53.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:53.798 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:44:53.802 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:44:53.808 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:44:53.818 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:44:54.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:54.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:54.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:54.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:54.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:54.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:54.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:54.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:54.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:54.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:54.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:54.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:55.224 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:44:55.227 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:44:55.232 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455095 2023-09-23T07:44:55.232 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455095 -le 1695457101 ]] 2023-09-23T07:44:55.232 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:44:55.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:44:55.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:44:56.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:44:56.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:44:56.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:44:56.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:56.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:56.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:56.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:56.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:56.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:56.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:56.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:44:56.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:44:56.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:44:56.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:44:56.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:44:56.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:44:56.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:44:56.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:44:56.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:44:56.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:00.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:00.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:00.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:00.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:00.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:00.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:00.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:00.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:00.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:00.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:00.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:00.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:00.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:00.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:00.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:00.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:02.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:02.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:02.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:02.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:02.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:02.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:02.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:02.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:02.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:02.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:02.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:02.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:02.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:02.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:02.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:02.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:03.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:03.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:03.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:03.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:03.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:03.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:03.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:03.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:03.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:03.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:03.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:03.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:03.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:03.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:03.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:03.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:03.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:04.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:04.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:04.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:04.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:04.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:04.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:04.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:04.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:04.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:04.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:04.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:04.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:04.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:04.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:04.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:04.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:04.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:04.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:04.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:04.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:04.633 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:04.633+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:45:05.234 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:45:05.235 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:45:05.239 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:45:05.240 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:45:05.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:05.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:05.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:05.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:05.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:05.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:05.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:05.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:05.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:05.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:05.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:05.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:06.823 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:45:06.823 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:45:06.830 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455106 2023-09-23T07:45:06.830 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455106 -le 1695457101 ]] 2023-09-23T07:45:06.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:45:06.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:45:06.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:45:08.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:08.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:08.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:08.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:08.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:08.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:08.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:08.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:08.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:08.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:08.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:08.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:09.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:09.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:09.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:09.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:09.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:09.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:09.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:09.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:09.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:09.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:09.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:09.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:09.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:09.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:09.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:09.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:09.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:09.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:09.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:09.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:09.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:09.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:09.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:10.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:10.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:10.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:10.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:10.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:10.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:10.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:10.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:10.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:10.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:10.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:10.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:10.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:10.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:10.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:10.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:10.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:10.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:10.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:10.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:11.216 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:11.213+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:45:11.216 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:11.217+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:45:12.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:12.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:12.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:12.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:12.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:12.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:12.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:12.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:12.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:12.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:12.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:12.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:12.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:12.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:12.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:12.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:12.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:12.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:12.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:12.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:13.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:13.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:13.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:13.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:13.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:13.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:13.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:13.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:13.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:13.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:13.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:13.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:13.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:13.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:13.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:13.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:13.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:13.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:13.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:13.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:13.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:13.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:13.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:13.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:13.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:13.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:13.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:13.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:13.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:13.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:13.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:13.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:13.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:13.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:13.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:13.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:13.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:13.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:13.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:13.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:13.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:13.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:13.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:15.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:15.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:15.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:15.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:15.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:15.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:15.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:15.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:15.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:15.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:15.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:15.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:15.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:15.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:15.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:15.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:15.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:15.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:15.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:15.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:15.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:15.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:15.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:15.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:15.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:15.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:15.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:15.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:15.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:16.041 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:16.041+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:45:16.056 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:16.057+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:45:16.056 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:16.057+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:45:16.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:16.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:16.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:16.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:16.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:16.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:16.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:16.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:16.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:16.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:16.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:16.838 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:45:16.839 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:45:16.849 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:45:16.865 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:45:16.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:16.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:16.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:16.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:16.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:16.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:16.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:16.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:16.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:16.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:16.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:16.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:17.474 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:17.473+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:45:17.474 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:17.473+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:45:17.475 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:17.473+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:45:17.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:17.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:17.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:17.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:17.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:17.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:18.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:18.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:18.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:18.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:18.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:18.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:18.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:18.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:18.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:18.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:18.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:18.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:18.329 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:45:18.330 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:45:18.331 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455118 2023-09-23T07:45:18.331 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455118 -le 1695457101 ]] 2023-09-23T07:45:18.331 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:45:18.331 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:45:18.332 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:45:18.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:18.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:18.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:18.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:18.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:18.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:19.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:19.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:19.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:19.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:19.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:19.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:19.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:19.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:19.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:19.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:19.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:19.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:20.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:20.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:20.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:20.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:20.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:20.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:20.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:20.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:20.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:20.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:20.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:20.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:20.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:20.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:20.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:20.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:20.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:20.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:22.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:22.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:22.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:22.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:22.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:22.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:22.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:22.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:22.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:22.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:22.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:22.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:22.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:22.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:22.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:22.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:23.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:23.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:23.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:23.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:23.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:23.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:23.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:23.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:23.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:23.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:23.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:23.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:23.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:23.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:23.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:23.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:23.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:23.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:23.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:23.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:24.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:24.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:24.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:24.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:24.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:24.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:24.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:24.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:24.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:24.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:24.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:24.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:24.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:24.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:24.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:24.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:25.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:25.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:25.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:25.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:25.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:25.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:25.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:25.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:26.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:26.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:26.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:26.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:26.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:26.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:26.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:26.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:26.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:26.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:26.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:26.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:26.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:27.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:27.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:27.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:27.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:27.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:27.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:27.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:27.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:27.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:27.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:27.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:27.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:27.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:28.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:28.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:28.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:28.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:28.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:28.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:28.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:28.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:28.184 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:28.177+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:45:28.184 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:28.177+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:45:28.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:28.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:28.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:28.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:28.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:28.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:28.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:28.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:28.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:28.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:28.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:28.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:28.333 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:45:28.334 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:45:28.341 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:45:28.353 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:45:29.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:29.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:29.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:29.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:29.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:29.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:29.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:29.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:29.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:29.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:29.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:29.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:29.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:29.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:29.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:29.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:29.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:29.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:29.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:29.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:29.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:29.720 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:45:29.721 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:45:29.721 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455129 2023-09-23T07:45:29.722 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455129 -le 1695457101 ]] 2023-09-23T07:45:29.722 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:45:29.722 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:45:29.722 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:45:29.836 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:29.837+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:45:29.837 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:29.837+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:45:29.837 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:29.837+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:45:30.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:30.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:30.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:30.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:30.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:30.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:30.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:30.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:30.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:30.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:30.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:30.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:30.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:30.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:30.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:30.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:30.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:30.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:30.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:30.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:30.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:30.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:30.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:30.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:30.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:30.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:30.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:31.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:31.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:31.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:31.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:31.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:31.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:31.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:31.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:31.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:31.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:31.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:31.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:31.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:31.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:31.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:31.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:31.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:32.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:32.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:32.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:32.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:33.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:33.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:33.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:33.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:33.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:33.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:33.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:33.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:33.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:33.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:33.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:33.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:34.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:34.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:34.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:34.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:34.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:34.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:34.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:34.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:34.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:34.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:34.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:34.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:35.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:35.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:35.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:35.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:35.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:35.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:35.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:35.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:35.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:35.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:35.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:35.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:35.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:35.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:35.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:35.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:35.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:35.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:36.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:36.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:36.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:36.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:36.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:36.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:36.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:36.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:36.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:36.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:36.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:36.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:37.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:37.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:37.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:37.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:38.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:38.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:38.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:38.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:38.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:38.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:38.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:38.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:38.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:38.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:38.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:38.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:38.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:38.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:38.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:38.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:38.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:38.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:38.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:38.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:39.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:39.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:39.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:39.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:39.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:39.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:39.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:39.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:39.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:39.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:39.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:39.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:39.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:39.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:39.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:39.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:39.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:39.705 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:39.705+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:45:39.705 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:39.705+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:45:39.705 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:39.705+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:45:39.728 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:45:39.728 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:45:39.735 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:45:39.736 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:45:40.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:40.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:40.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:40.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:40.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:40.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:40.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:40.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:40.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:40.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:40.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:40.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:40.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:40.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:40.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:40.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:40.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:40.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:40.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:40.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:40.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:40.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:40.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:40.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:40.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:40.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:40.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:40.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:40.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:40.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:40.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:41.144 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:45:41.144 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:45:41.144 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455141 2023-09-23T07:45:41.145 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455141 -le 1695457101 ]] 2023-09-23T07:45:41.145 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:45:41.145 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:45:41.145 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:45:41.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:41.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:41.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:41.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:41.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:41.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:42.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:42.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:42.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:42.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:42.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:42.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:42.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:42.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:42.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:42.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:42.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:42.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:42.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:42.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:42.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:42.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:42.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:42.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:42.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:42.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:42.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:42.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:44.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:44.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:44.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:44.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:44.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:44.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:44.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:44.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:44.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:44.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:44.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:44.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:44.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:44.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:44.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:44.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:44.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:44.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:44.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:44.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:44.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:44.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:44.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:44.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:44.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:44.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:44.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:44.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:44.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:44.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:44.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:44.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:44.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:44.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:44.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:44.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:44.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:44.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:44.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:44.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:44.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:44.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:44.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:44.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:46.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:46.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:46.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:46.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:46.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:46.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:46.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:46.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:46.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:46.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:46.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:46.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:46.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:46.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:46.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:46.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:47.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:47.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:47.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:47.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:47.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:47.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:47.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:47.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:47.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:47.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:47.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:47.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:47.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:47.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:47.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:47.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:47.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:47.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:48.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:48.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:48.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:48.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:48.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:48.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:48.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:48.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:48.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:48.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:48.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:48.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:48.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:48.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:48.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:48.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:49.242 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:49.237+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:45:49.242 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:49.237+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:45:50.822 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:50.821+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:45:50.822 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:45:50.821+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:45:51.161 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:45:51.163 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:45:51.180 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:45:51.200 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:45:51.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:51.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:51.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:51.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:51.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:51.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:51.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:51.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:51.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:51.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:51.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:51.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:51.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:51.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:52.445 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:45:52.459 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:45:52.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455152 2023-09-23T07:45:52.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455152 -le 1695457101 ]] 2023-09-23T07:45:52.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:45:52.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:45:52.460 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:45:52.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:52.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:52.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:52.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:52.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:52.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:52.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:52.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:53.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:53.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:53.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:53.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:53.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:53.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:53.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:53.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:53.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:53.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:53.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:53.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:53.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:53.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:54.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:54.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:54.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:54.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:54.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:54.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:54.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:54.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:54.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:54.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:54.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:54.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:54.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:54.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:54.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:54.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:55.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:55.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:55.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:55.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:55.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:55.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:55.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:55.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:55.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:55.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:56.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:56.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:56.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:56.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:56.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:56.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:56.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:56.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:56.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:56.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:56.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:56.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:56.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:56.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:56.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:56.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:56.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:56.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:57.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:57.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:57.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:57.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:57.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:57.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:57.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:57.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:57.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:57.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:57.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:57.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:57.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:57.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:57.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:57.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:57.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:57.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:57.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:57.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:57.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:57.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:57.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:57.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:57.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:57.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:57.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:45:59.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:45:59.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:45:59.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:45:59.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:45:59.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:45:59.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:45:59.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:45:59.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:45:59.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:45:59.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:45:59.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:45:59.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:45:59.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:00.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:00.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:00.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:00.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:00.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:00.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:00.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:00.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:00.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:00.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:00.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:00.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:00.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:00.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:00.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:00.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:01.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:01.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:01.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:01.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:01.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:01.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:01.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:01.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:01.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:01.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:01.333 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:46:01.332+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:46:01.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:01.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:01.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:02.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:02.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:02.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:02.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:02.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:02.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:02.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:02.467 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:46:02.470 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:46:02.472 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:46:02.472 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:46:02.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:02.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:02.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:02.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:02.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:02.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:02.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:02.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:02.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:02.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:02.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:03.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:03.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:03.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:03.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:03.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:03.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:03.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:03.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:03.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:03.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:03.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:03.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:03.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:03.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:03.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:03.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:03.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:03.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:03.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:03.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:03.708 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:46:03.713 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:46:03.714 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455163 2023-09-23T07:46:03.714 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455163 -le 1695457101 ]] 2023-09-23T07:46:03.714 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:46:03.715 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:46:03.715 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:46:04.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:04.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:04.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:04.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:05.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:05.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:05.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:05.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:46:05.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:05.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:05.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:05.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:05.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:05.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:05.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:05.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:05.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:05.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:05.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:07.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:07.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:07.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:07.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:07.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:07.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:07.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:07.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:07.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:07.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:08.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:08.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:08.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:08.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:08.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:08.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:08.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:08.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:08.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:08.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:08.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:08.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:09.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:09.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:09.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:09.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:09.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:09.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:09.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:09.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:09.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:09.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:09.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:09.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:11.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:11.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:11.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:11.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:11.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:11.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:11.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:11.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:11.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:11.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:11.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:11.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:11.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:11.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:11.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:11.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:11.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:11.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:11.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:11.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:11.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:11.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:12.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:12.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:12.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:12.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:12.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:12.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:12.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:12.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:12.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:12.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:12.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:12.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:12.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:12.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:12.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:12.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:12.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:12.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:12.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:12.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:13.724 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:46:13.724 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:46:13.733 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:46:13.741 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:46:14.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:14.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:14.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:14.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:14.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:14.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:14.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:14.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:14.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:14.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:14.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:14.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:14.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:14.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:14.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:14.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:14.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:14.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:14.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:14.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:14.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:15.383 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:46:15.385 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:46:15.390 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455175 2023-09-23T07:46:15.390 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455175 -le 1695457101 ]] 2023-09-23T07:46:15.390 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:46:15.390 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:46:15.390 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:46:15.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:15.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:15.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:15.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:15.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:15.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:15.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:15.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:15.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:15.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:15.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:15.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:15.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:15.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:15.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:15.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:15.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:15.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:15.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:15.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:16.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:16.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:16.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:16.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:16.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:16.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:16.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:16.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:16.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:16.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:16.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:16.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:16.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:16.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:16.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:16.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:17.053 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:17.052+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:46:18.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:18.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:18.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:18.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:18.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:18.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:18.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:18.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:18.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:18.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:20.778 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:20.776+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:46:20.778 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:20.776+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:46:21.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:21.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:21.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:21.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:21.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:21.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:21.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:21.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:21.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:21.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:21.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:21.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:22.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:22.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:22.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:22.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:22.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:22.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:22.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:22.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:22.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:22.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:22.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:22.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:22.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:22.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:22.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:23.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:23.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:23.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:23.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:23.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:23.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:23.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:23.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:24.526 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:24.524+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:46:24.526 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:24.524+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:46:24.526 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:24.524+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:46:24.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:24.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:24.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:24.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:25.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:25.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:25.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:25.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:25.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:25.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:25.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:25.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:25.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:25.397 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:46:25.403 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:46:25.408 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:46:25.413 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:46:25.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:25.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:25.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:25.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:25.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:25.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:25.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:25.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:25.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:25.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:25.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:26.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:26.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:26.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:26.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:26.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:26.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:26.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:26.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:26.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:26.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:26.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:26.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:26.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:26.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:26.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:26.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:26.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:26.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:26.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:46:26.983 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:46:26.984 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455186 2023-09-23T07:46:26.985 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455186 -le 1695457101 ]] 2023-09-23T07:46:26.985 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:46:26.985 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:46:26.985 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:46:28.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:28.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:28.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:28.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:28.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:28.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:28.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:28.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:28.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:28.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:28.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:28.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:28.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:28.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:28.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:28.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:28.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:28.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:28.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:31.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:31.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:31.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:31.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:31.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:31.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:31.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:31.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:31.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:31.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:31.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:31.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:31.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:31.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:31.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:31.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:32.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:32.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:32.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:32.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:32.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:32.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:32.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:32.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:32.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:32.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:32.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:32.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:32.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:32.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:32.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:32.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:32.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:33.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:33.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:33.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:33.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:33.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:33.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:33.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:33.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:33.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:33.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:33.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:33.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:33.886 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:33.884+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:46:33.886 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:33.884+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:46:34.113 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:34.112+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:46:35.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:35.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:35.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:35.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:35.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:35.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:35.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:35.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:35.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:35.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:35.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:35.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:35.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:35.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:35.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:35.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:35.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:35.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:35.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:35.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:36.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:36.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:36.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:36.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:36.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:36.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:36.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:36.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:36.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:36.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:36.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:36.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:36.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:36.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:36.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:36.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:36.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:36.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:36.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:36.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:36.993 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:46:37.001 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:46:37.007 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:46:37.022 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:46:38.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:38.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:38.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:38.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:38.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:38.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:38.341 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:46:38.343 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:46:38.348 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455198 2023-09-23T07:46:38.348 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455198 -le 1695457101 ]] 2023-09-23T07:46:38.348 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:46:38.348 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:46:38.348 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:46:38.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:38.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:38.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:38.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:38.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:38.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:38.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:38.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:38.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:38.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:38.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:38.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:38.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:38.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:40.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:40.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:40.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:40.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:40.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:40.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:40.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:40.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:40.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:40.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:40.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:40.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:40.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:40.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:40.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:40.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:40.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:40.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:41.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:41.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:41.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:41.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:41.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:41.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:41.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:41.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:41.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:41.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:41.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:41.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:41.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:41.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:41.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:41.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:41.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:41.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:41.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:41.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:42.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:42.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:42.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:42.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:42.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:42.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:42.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:42.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:42.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:42.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:42.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:42.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:42.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:42.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:42.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:42.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:42.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:42.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:42.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:42.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:42.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:42.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:42.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:43.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:43.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:43.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:43.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:43.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:43.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:43.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:43.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:43.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:43.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:43.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:43.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:43.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:43.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:43.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:43.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:43.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:43.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:43.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:43.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:43.708 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:43.704+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:46:43.709 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:43.704+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:46:43.709 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:43.704+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:46:46.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:46.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:46.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:46.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:46.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:46.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:46.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:46.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:46.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:46.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:46.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:46.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:47.408 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:47.408+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:46:47.408 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:47.408+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:46:47.408 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:47.408+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:46:48.372 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:46:48.387 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:46:48.398 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:46:48.407 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:46:49.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:49.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:49.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:49.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:49.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:49.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:49.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:49.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:49.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:49.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:49.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:49.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:49.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:49.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:49.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:49.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:49.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:49.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:49.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:49.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:49.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:49.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:49.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:49.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:49.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:49.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:49.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:49.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:49.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:49.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:49.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:49.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:49.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:49.712 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:46:49.715 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:46:49.716 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455209 2023-09-23T07:46:49.716 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455209 -le 1695457101 ]] 2023-09-23T07:46:49.716 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:46:49.716 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:46:49.716 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:46:49.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:49.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:49.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:49.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:49.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:49.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:49.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:49.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:49.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:49.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:50.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:50.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:50.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:50.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:50.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:50.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:50.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:50.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:52.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:52.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:52.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:52.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:52.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:52.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:52.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:52.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:52.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:52.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:52.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:52.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:54.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:54.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:54.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:54.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:54.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:54.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:54.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:54.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:54.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:54.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:54.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:54.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:54.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:54.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:54.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:54.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:54.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:54.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:55.278 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:55.276+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:46:55.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:55.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:55.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:55.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:55.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:55.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:55.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:55.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:55.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:55.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:55.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:55.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:55.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:55.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:55.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:55.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:55.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:55.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:55.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:55.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:56.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:56.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:56.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:56.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:56.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:56.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:56.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:56.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:56.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:56.729 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:56.728+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:46:56.729 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:56.728+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:46:56.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:56.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:56.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:56.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:56.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:56.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:56.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:56.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:56.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:56.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:56.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:57.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:57.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:46:57.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:57.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:57.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:57.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:57.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:57.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:57.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:57.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:46:57.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:57.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:57.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:57.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:57.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:57.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:57.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:57.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:57.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:57.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:58.222 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:58.219+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:46:58.222 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:58.219+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:46:58.222 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:58.219+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:46:58.223 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:58.219+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:46:58.223 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:46:58.219+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:46:58.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:58.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:46:58.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:58.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:46:58.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:58.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:46:58.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:58.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:46:58.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:58.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:46:58.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:58.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:46:58.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:58.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:46:58.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:58.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:46:58.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:46:58.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:46:59.719 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:46:59.719 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:46:59.736 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:46:59.756 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:47:01.179 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:47:01.179 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:47:01.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455221 2023-09-23T07:47:01.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455221 -le 1695457101 ]] 2023-09-23T07:47:01.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:47:01.181 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:47:01.181 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:47:01.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:01.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:01.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:01.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:01.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:01.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:01.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:01.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:01.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:01.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:01.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:01.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:02.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:02.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:02.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:02.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:02.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:02.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:02.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:02.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:02.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:02.494 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:02.491+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:47:02.494 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:02.491+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:47:02.494 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:02.491+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:47:02.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:02.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:02.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:02.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:02.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:02.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:02.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:02.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:02.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:03.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:03.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:03.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:03.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:03.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:03.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:03.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:03.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:03.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:03.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:03.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:04.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:04.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:04.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:04.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:04.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:04.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:04.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:04.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:04.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:04.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:04.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:04.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:04.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:04.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:04.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:04.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:04.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:04.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:04.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:04.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:05.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:05.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:05.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:05.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:05.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:05.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:05.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:05.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:05.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:05.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:05.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:05.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:05.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:05.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:05.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:05.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:05.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:05.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:05.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:05.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:05.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:05.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:05.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:05.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:05.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:05.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:05.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:05.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:05.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:09.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:09.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:09.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:09.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:09.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:09.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:09.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:09.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:09.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:09.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:09.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:09.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:47:09.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:09.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:09.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:09.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:09.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:09.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:09.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:09.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:09.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:09.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:09.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:09.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:10.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:10.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:10.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:10.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:10.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:10.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:10.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:10.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:10.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:10.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:10.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:10.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:11.187 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:47:11.187 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:47:11.195 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:47:11.200 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:47:11.241 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:11.239+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:47:12.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:12.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:12.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:12.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:12.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:12.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:12.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:12.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:12.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:12.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:12.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:12.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:12.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:12.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:12.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:12.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:12.619 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:47:12.620 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:47:12.620 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455232 2023-09-23T07:47:12.620 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455232 -le 1695457101 ]] 2023-09-23T07:47:12.620 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:47:12.620 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:47:12.621 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:47:12.904 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:12.899+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:47:14.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:14.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:14.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:14.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:14.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:14.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:14.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:14.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:14.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:14.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:14.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:14.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:14.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:14.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:14.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:14.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:14.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:14.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:15.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:15.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:15.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:15.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:15.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:15.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:15.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:15.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:15.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:15.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:15.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:15.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:15.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:15.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:15.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:15.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:17.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:17.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:17.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:17.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:17.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:17.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:17.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:17.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:17.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:17.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:17.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:17.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:17.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:17.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:17.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:17.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:18.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:18.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:18.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:18.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:18.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:18.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:18.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:18.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:18.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:18.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:18.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:18.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:18.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:18.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:18.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:18.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:18.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:18.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:18.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:18.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:19.489 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:47:19.487+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:47:20.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:20.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:20.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:20.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:20.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:20.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:20.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:20.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:20.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:20.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:20.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:20.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:20.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:20.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:20.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:20.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:20.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:20.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:21.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:21.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:21.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:21.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:21.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:21.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:21.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:21.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:21.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:21.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:21.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:21.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:21.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:21.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:22.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:22.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:22.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:22.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:22.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:22.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:22.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:22.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:22.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:22.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:22.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:22.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:22.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:22.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:22.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:22.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:22.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:22.630 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:47:22.631 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:47:22.639 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:47:22.653 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:47:23.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:23.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:23.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:23.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:23.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:23.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:23.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:23.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:23.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:23.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:23.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:23.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:24.298 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:47:24.299 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:47:24.301 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455244 2023-09-23T07:47:24.301 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455244 -le 1695457101 ]] 2023-09-23T07:47:24.301 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:47:24.301 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:47:24.301 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:47:24.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:24.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:24.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:24.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:24.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:24.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:24.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:24.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:24.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:24.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:24.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:24.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:24.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:24.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:24.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:24.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:24.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:24.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:24.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:24.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:26.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:26.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:26.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:26.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:26.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:26.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:26.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:26.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:26.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:26.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:26.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:26.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:26.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:26.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:26.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:26.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:26.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:26.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:28.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:28.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:28.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:28.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:28.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:28.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:28.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:28.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:28.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:28.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:28.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:28.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:28.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:28.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:28.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:28.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:28.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:28.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:28.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:28.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:28.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:28.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:29.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:29.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:29.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:29.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:29.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:29.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:29.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:29.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:29.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:29.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:29.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:29.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:29.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:29.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:29.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:29.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:29.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:29.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:30.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:47:30.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:30.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:30.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:30.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:30.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:30.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:30.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:30.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:30.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:30.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:30.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:30.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:32.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:32.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:32.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:32.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:32.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:32.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:32.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:32.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:32.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:32.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:32.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:32.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:32.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:32.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:32.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:32.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:32.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:33.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:33.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:33.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:33.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:33.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:33.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:33.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:33.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:33.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:33.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:33.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:33.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:34.303 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:47:34.334 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:47:34.335 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:47:34.336 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:47:35.356 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:47:35.357 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:47:35.358 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455255 2023-09-23T07:47:35.358 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455255 -le 1695457101 ]] 2023-09-23T07:47:35.358 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:47:35.358 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:47:35.358 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:47:35.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:35.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:47:35.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:35.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:35.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:35.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:35.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:35.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:35.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:35.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:35.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:35.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:35.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:35.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:35.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:35.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:35.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:35.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:35.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:35.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:36.073 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:36.071+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:47:36.261 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:36.259+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:47:36.262 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:36.259+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:47:36.262 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:36.259+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:47:36.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:36.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:36.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:36.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:36.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:36.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:36.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:36.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:36.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:36.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:36.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:36.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:37.188 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:37.187+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:47:37.188 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:37.187+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:47:38.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:38.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:38.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:38.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:38.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:38.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:38.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:38.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:38.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:38.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:38.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:38.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:40.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:40.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:40.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:40.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:40.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:40.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:40.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:40.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:40.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:40.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:40.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:40.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:41.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:47:41.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:41.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:41.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:41.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:41.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:41.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:41.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:41.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:41.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:41.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:41.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:41.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:42.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:42.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:42.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:42.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:42.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:42.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:42.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:42.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:42.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:42.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:42.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:42.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:44.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:44.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:44.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:44.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:44.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:44.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:44.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:44.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:44.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:44.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:44.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:44.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:44.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:44.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:44.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:44.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:45.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:45.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:45.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:45.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:45.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:45.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:45.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:45.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:45.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:45.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:45.360 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:47:45.360 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:47:45.360 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:47:45.372 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:47:46.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:46.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:46.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:46.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:46.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:46.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:46.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:46.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:46.629 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:47:46.629 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:47:46.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:46.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:46.630 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455266 2023-09-23T07:47:46.630 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455266 -le 1695457101 ]] 2023-09-23T07:47:46.630 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:47:46.630 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:47:46.631 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:47:46.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:46.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:46.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:46.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:46.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:46.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:46.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:46.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:46.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:46.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:46.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:47.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:47.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:47.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:47.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:47.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:47.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:47.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:47.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:47.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:47.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:47.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:47.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:47.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:47.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:47.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:47.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:47.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:47.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:47.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:47.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:47.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:48.641 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:48.635+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:47:48.641 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:48.635+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:47:48.641 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:48.635+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:47:50.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:50.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:50.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:50.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:50.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:50.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:50.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:50.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:50.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:50.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:50.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:50.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:50.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:51.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:51.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:51.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:51.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:51.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:51.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:51.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:51.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:51.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:51.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:51.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:51.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:51.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:47:51.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:51.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:51.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:51.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:51.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:51.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:51.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:51.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:51.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:51.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:51.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:51.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:51.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:51.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:51.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:51.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:51.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:51.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:51.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:51.872 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:47:51.870+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:47:51.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:51.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:51.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:51.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:51.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:51.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:51.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:52.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:52.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:52.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:52.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:52.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:52.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:52.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:52.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:53.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:53.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:53.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:53.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:53.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:53.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:53.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:53.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:53.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:53.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:53.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:53.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:53.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:53.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:53.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:53.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:54.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:54.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:54.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:54.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:54.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:54.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:54.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:54.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:54.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:54.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:54.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:54.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:54.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:54.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:54.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:54.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:54.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:54.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:55.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:55.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:55.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:55.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:55.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:55.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:55.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:55.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:55.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:55.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:55.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:55.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:55.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:55.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:55.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:55.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:55.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:55.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:55.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:55.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:55.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:55.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:56.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:56.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:56.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:56.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:56.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:56.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:56.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:56.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:56.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:56.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:56.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:56.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:56.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:56.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:56.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:56.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:56.652 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:47:56.652 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:47:56.652 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:47:56.655 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:47:57.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:57.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:57.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:57.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:57.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:57.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:57.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:57.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:57.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:57.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:57.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:57.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:58.008 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:47:58.012 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:47:58.015 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455278 2023-09-23T07:47:58.015 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455278 -le 1695457101 ]] 2023-09-23T07:47:58.015 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:47:58.015 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:47:58.015 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:47:58.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:47:58.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:58.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:58.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:58.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:58.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:58.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:58.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:58.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:58.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:58.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:58.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:47:59.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:59.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:47:59.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:59.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:47:59.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:59.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:47:59.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:59.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:47:59.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:59.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:47:59.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:59.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:47:59.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:59.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:47:59.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:59.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:47:59.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:59.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:47:59.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:47:59.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:01.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:01.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:01.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:01.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:01.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:01.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:01.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:01.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:01.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:01.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:01.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:48:01.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:01.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:01.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:01.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:01.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:01.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:01.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:01.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:01.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:01.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:01.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:01.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:01.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:01.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:01.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:01.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:01.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:01.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:01.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:01.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:02.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:02.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:48:02.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:02.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:02.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:02.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:02.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:02.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:02.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:02.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:03.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:03.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:03.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:03.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:03.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:03.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:03.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:03.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:03.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:03.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:03.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:03.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:03.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:03.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:03.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:03.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:03.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:03.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:04.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:04.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:04.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:04.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:04.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:04.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:04.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:04.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:04.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:04.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:04.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:04.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:04.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:05.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:05.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:05.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:05.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:05.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:05.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:05.089 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:05.086+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:48:05.089 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:05.086+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:05.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:05.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:05.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:05.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:05.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:05.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:05.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:05.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:05.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:05.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:05.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:05.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:07.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:48:07.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:07.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:07.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:07.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:07.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:07.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:07.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:07.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:07.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:07.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:07.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:07.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:08.020 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:48:08.020 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:48:08.020 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:48:08.037 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:48:08.237 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:48:08.234+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:48:09.459 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:48:09.465 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:48:09.469 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455289 2023-09-23T07:48:09.469 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455289 -le 1695457101 ]] 2023-09-23T07:48:09.469 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:48:09.469 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:48:09.469 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:48:09.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:09.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:09.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:09.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:09.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:09.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:09.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:09.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:09.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:09.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:09.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:09.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:09.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:09.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:09.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:09.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:09.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:09.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:09.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:09.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:11.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:11.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:11.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:11.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:11.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:11.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:11.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:11.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:11.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:11.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:11.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:11.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:11.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:11.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:11.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:11.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:11.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:11.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:11.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:11.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:11.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:11.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:48:11.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:11.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:11.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:11.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:12.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:12.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:12.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:12.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:12.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:12.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:12.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:48:12.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:12.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:12.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:12.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:12.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:12.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:12.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:12.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:12.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:12.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:12.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:12.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:13.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:13.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:13.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:13.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:13.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:13.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:13.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:13.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:13.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:13.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:13.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:13.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:13.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:13.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:13.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:14.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:14.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:14.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:14.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:14.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:14.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:14.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:14.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:14.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:14.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:14.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:14.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:14.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:14.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:14.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:14.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:14.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:14.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:15.681 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:15.678+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:16.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:16.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:16.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:16.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:16.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:16.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:16.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:16.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:16.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:16.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:16.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:16.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:16.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:16.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:16.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:16.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:16.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:16.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:16.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:16.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:17.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:17.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:17.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:17.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:17.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:17.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:17.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:17.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:17.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:17.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:17.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:17.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:19.474 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:48:19.474 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:48:19.475 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:48:19.479 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:48:20.392 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:20.390+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:48:20.393 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:20.390+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:20.985 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:48:20.985 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:48:20.986 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455300 2023-09-23T07:48:20.987 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455300 -le 1695457101 ]] 2023-09-23T07:48:20.987 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:48:20.987 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:48:20.987 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:48:21.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:21.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:21.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:21.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:21.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:21.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:21.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:21.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:21.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:21.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:21.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:21.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:21.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:21.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:21.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:21.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:21.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:21.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:22.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:22.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:22.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:22.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:22.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:22.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:22.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:22.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:22.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:22.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:22.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:22.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:22.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:22.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:22.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:22.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:22.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:22.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:22.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:22.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:23.211 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:23.206+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:48:23.211 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:23.206+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:24.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:24.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:24.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:24.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:24.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:24.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:24.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:24.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:24.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:24.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:24.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:48:24.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:24.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:24.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:24.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:24.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:24.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:24.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:24.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:24.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:24.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:24.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:25.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:25.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:25.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:25.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:25.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:25.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:25.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:25.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:25.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:25.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:25.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:25.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:25.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:25.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:25.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:27.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:27.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:27.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:27.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:27.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:27.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:27.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:27.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:27.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:27.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:27.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:27.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:27.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:27.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:27.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:27.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:27.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:27.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:28.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:28.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:28.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:28.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:28.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:28.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:28.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:28.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:28.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:28.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:28.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:28.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:28.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:28.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:28.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:28.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:28.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:28.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:30.366 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:30.362+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:30.989 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:48:30.991 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:48:30.991 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:48:30.991 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:48:31.074 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:48:31.070+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:48:31.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:31.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:31.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:31.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:31.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:31.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:31.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:31.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:31.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:31.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:31.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:31.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:31.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:31.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:31.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:31.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:31.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:31.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:32.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:32.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:32.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:32.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:32.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:32.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:32.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:32.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:32.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:32.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:32.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:32.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:32.449 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:48:32.456 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:48:32.457 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455312 2023-09-23T07:48:32.457 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455312 -le 1695457101 ]] 2023-09-23T07:48:32.457 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:48:32.457 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:48:32.457 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:48:33.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:33.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:33.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:33.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:33.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:33.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:33.322 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:33.318+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:48:33.322 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:33.318+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:33.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:33.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:33.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:33.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:33.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:33.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:33.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:33.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:33.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:33.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:33.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:33.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:34.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:33.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:34.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:34.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:34.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:34.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:34.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:34.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:34.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:34.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:35.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:35.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:35.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:35.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:35.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:35.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:35.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:35.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:35.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:35.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:35.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:48:35.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:35.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:35.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:35.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:35.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:35.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:35.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:35.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:35.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:35.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:35.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:35.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:38.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:38.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:38.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:38.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:38.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:38.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:38.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:38.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:38.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:38.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:38.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:38.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:38.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:38.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:38.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:38.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:38.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:38.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:38.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:38.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:38.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:38.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:39.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:39.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:39.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:39.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:39.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:39.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:39.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:39.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:39.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:39.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:39.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:39.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:39.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:39.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:39.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:39.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:41.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:41.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:41.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:41.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:41.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:41.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:41.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:41.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:41.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:41.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:41.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:41.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:41.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:41.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:41.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:41.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:41.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:41.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:41.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:41.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:42.463 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:48:42.468 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:48:42.471 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:48:42.479 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:48:42.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:42.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:42.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:42.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:42.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:42.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:42.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:42.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:42.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:42.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:42.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:42.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:42.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:42.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:42.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:42.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:42.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:42.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:42.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:42.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:44.092 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:48:44.092 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:48:44.092 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455324 2023-09-23T07:48:44.092 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455324 -le 1695457101 ]] 2023-09-23T07:48:44.093 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:48:44.093 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:48:44.093 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:48:44.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:44.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:44.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:44.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:44.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:44.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:44.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:44.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:44.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:44.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:44.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:44.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:44.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:44.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:44.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:44.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:44.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:44.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:44.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:44.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:46.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:46.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:46.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:46.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:46.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:46.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:46.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:46.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:46.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:46.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:46.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:46.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:46.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:46.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:46.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:46.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:46.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:46.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:46.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:46.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:48.107 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:48.105+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:48:48.107 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:48.105+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:48.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:48:48.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:48.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:48.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:48.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:48.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:48.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:48.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:48.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:48.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:48.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:48.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:48.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:50.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:50.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:50.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:50.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:50.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:50.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:50.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:50.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:50.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:50.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:50.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:50.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:50.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:50.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:50.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:50.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:51.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:51.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:51.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:51.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:51.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:51.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:51.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:51.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:51.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:51.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:51.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:51.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:51.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:51.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:51.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:51.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:51.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:51.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:51.832 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:51.829+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:48:51.832 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:51.829+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:52.295 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:52.293+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:48:52.296 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:52.293+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:48:52.296 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:52.293+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:53.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:53.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:53.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:53.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:53.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:53.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:53.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:53.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:53.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:53.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:53.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:53.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:53.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:53.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:53.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:53.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:53.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:53.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:53.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:53.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:53.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:53.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:53.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:53.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:53.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:53.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:53.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:53.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:53.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:53.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:54.033 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:54.033+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:48:54.033 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:54.033+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:54.102 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:48:54.102 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:48:54.113 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:48:54.114 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:48:54.525 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:54.525+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:48:54.525 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:54.525+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:48:54.571 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:54.569+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:48:54.572 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:54.569+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:48:54.572 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:54.569+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:55.690 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:48:55.690 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:48:55.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455335 2023-09-23T07:48:55.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455335 -le 1695457101 ]] 2023-09-23T07:48:55.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:48:55.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:48:55.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:48:56.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:56.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:56.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:56.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:56.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:56.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:56.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:56.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:56.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:56.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:56.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:56.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:56.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:56.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:56.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:56.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:56.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:56.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:56.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:56.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:56.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:56.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:57.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:57.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:57.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:57.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:57.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:57.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:57.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:57.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:57.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:57.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:57.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:57.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:57.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:57.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:57.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:57.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:57.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:57.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:57.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:57.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:57.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:57.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:57.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:58.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:58.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:58.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:58.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:48:58.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:48:58.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:58.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:58.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:58.759 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:58.757+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:48:58.784 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:58.785+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:48:58.784 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:48:58.785+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:48:58.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:58.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:58.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:58.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:58.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:58.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:58.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:48:59.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:48:59.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:58.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:48:59.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:59.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:48:59.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:59.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:48:59.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:59.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:48:59.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:59.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:48:59.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:59.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:48:59.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:59.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:48:59.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:59.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:48:59.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:48:59.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:00.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:00.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:00.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:00.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:00.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:00.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:00.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:00.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:00.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:00.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:00.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:00.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:00.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:00.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:00.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:00.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:00.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:00.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:00.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:00.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:00.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:01.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:01.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:01.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:01.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:01.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:01.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:01.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:01.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:01.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:01.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:01.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:01.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:01.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:01.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:01.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:01.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:01.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:01.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:01.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:01.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:04.562 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:04.561+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:49:04.562 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:04.561+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:49:05.695 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:49:05.695 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:49:05.695 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:49:05.696 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:49:06.882 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:49:06.888 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:49:06.889 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455346 2023-09-23T07:49:06.890 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455346 -le 1695457101 ]] 2023-09-23T07:49:06.890 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:49:06.890 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:49:06.890 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:49:06.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:06.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:07.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:07.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:07.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:07.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:07.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:07.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:07.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:07.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:07.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:07.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:07.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:07.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:07.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:07.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:08.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:08.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:08.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:08.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:08.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:08.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:08.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:08.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:08.593 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:08.593+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:49:08.593 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:08.593+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:49:08.594 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:08.593+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:49:08.597 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:08.597+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:49:08.598 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:08.597+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:49:08.598 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:08.597+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:49:08.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:08.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:08.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:08.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:08.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:08.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:08.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:08.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:08.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:08.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:08.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:09.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:09.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:09.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:09.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:09.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:09.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:09.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:09.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:09.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:09.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:09.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:09.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:09.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:09.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:09.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:09.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:11.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:11.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:11.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:11.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:11.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:11.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:11.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:11.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:11.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:11.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:11.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:11.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:11.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:11.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:11.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:11.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:12.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:12.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:12.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:12.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:12.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:12.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:12.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:12.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:12.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:12.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:12.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:12.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:13.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:13.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:13.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:13.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:13.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:13.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:13.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:49:13.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:13.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:13.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:13.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:13.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:13.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:13.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:13.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:13.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:13.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:16.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:49:16.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:16.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:16.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:16.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:16.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:16.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:16.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:16.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:16.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:16.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:16.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:16.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:49:16.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:16.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:16.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:16.892 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:49:16.895 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:49:16.895 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:49:16.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:16.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:16.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:16.898 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:49:16.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:16.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:16.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:16.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:16.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:16.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:18.412 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:49:18.412 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:49:18.413 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455358 2023-09-23T07:49:18.413 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455358 -le 1695457101 ]] 2023-09-23T07:49:18.413 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:49:18.413 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:49:18.413 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:49:19.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:19.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:19.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:19.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:19.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:19.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:19.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:19.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:19.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:19.552 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:19.549+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:49:19.552 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:19.549+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:49:19.558 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:19.557+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:49:19.558 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:19.557+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:49:19.697 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:19.685+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:49:19.706 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:19.705+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:49:19.706 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:19.705+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:49:19.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:19.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:19.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:19.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:19.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:19.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:19.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:19.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:19.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:19.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:19.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:19.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:19.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:19.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:19.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:20.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:20.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:20.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:20.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:20.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:20.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:20.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:49:20.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:20.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:20.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:20.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:20.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:20.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:21.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:21.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:21.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:21.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:21.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:21.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:21.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:21.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:21.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:21.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:21.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:21.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:21.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:21.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:21.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:21.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:22.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:22.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:22.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:22.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:22.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:22.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:22.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:22.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:22.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:22.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:22.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:22.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:22.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:22.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:22.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:22.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:22.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:22.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:25.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:24.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:25.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:25.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:25.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:25.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:25.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:25.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:25.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:25.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:25.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:25.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:25.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:25.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:25.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:25.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:26.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:26.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:26.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:26.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:26.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:26.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:26.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:26.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:26.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:26.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:26.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:26.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:26.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:26.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:26.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:26.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:26.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:26.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:26.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:26.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:26.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:26.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:26.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:26.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:26.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:26.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:26.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:27.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:27.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:27.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:27.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:27.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:27.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:27.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:27.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:27.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:27.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:27.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:27.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:28.434 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:49:28.435 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:49:28.436 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:49:28.440 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:49:28.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:28.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:28.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:28.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:28.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:28.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:28.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:28.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:28.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:28.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:28.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:28.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:28.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:28.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:28.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:28.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:28.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:28.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:28.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:28.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:29.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:29.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:29.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:29.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:29.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:29.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:29.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:29.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:29.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:29.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:29.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:29.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:29.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:29.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:29.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:29.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:29.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:29.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:30.138 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:49:30.138 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:49:30.139 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455370 2023-09-23T07:49:30.139 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455370 -le 1695457101 ]] 2023-09-23T07:49:30.139 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:49:30.139 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:49:30.139 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:49:30.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:30.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:30.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:30.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:30.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:30.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:30.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:30.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:30.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:30.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:30.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:30.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:30.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:30.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:30.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:30.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:30.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:30.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:30.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:30.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:30.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:32.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:49:32.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:32.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:32.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:32.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:32.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:32.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:32.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:32.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:32.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:32.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:32.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:32.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:49:32.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:32.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:32.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:32.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:32.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:32.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:32.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:32.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:32.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:32.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:32.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:32.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:32.507 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:32.505+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:49:32.521 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:32.521+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:49:32.522 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:32.521+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:49:32.522 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:32.521+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:49:34.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:34.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:34.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:34.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:34.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:34.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:34.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:34.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:34.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:34.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:34.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:34.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:34.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:34.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:34.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:34.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:34.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:34.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:35.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:35.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:35.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:35.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:35.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:35.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:35.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:35.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:35.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:35.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:35.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:35.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:35.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:35.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:35.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:35.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:35.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:35.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:35.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:35.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:36.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:36.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:36.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:36.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:36.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:36.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:36.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:36.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:36.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:36.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:36.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:36.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:37.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:37.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:37.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:37.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:37.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:37.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:37.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:37.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:37.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:37.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:37.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:37.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:38.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:38.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:38.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:38.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:38.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:38.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:38.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:38.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:39.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:39.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:39.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:39.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:39.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:39.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:39.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:39.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:39.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:39.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:39.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:39.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:39.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:39.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:39.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:39.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:39.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:39.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:39.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:39.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:40.141 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:49:40.141 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:49:40.152 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:49:40.153 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:49:41.411 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:49:41.411 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:49:41.412 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455381 2023-09-23T07:49:41.412 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455381 -le 1695457101 ]] 2023-09-23T07:49:41.412 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:49:41.412 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:49:41.412 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:49:41.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:41.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:41.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:41.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:41.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:41.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:41.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:41.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:41.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:41.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:41.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:41.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:41.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:41.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:42.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:42.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:42.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:42.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:42.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:42.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:42.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:42.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:42.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:42.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:42.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:42.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:42.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:42.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:42.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:42.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:42.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:42.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:42.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:42.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:42.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:43.782 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:43.781+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:49:43.782 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:43.781+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:49:47.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:47.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:47.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:47.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:47.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:47.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:48.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:48.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:48.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:48.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:48.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:48.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:48.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:48.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:48.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:48.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:48.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:48.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:51.429 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:49:51.437 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:49:51.439 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:49:51.443 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:49:52.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:49:52.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:52.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:52.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:52.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:52.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:52.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:52.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:52.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:52.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:52.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:52.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:52.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:52.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:52.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:52.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:52.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:52.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:52.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:52.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:53.002 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:49:53.002 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:49:53.003 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455393 2023-09-23T07:49:53.003 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455393 -le 1695457101 ]] 2023-09-23T07:49:53.003 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:49:53.003 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:49:53.004 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:49:54.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:54.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:54.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:54.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:54.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:54.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:54.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:54.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:54.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:54.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:54.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:54.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:54.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:54.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:54.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:54.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:54.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:54.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:54.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:54.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:54.423 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:54.420+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:49:54.423 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:54.420+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:49:54.423 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:54.420+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:49:55.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:55.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:55.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:55.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:55.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:55.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:55.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:55.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:55.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:55.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:55.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:55.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:55.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:55.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:55.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:55.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:55.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:55.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:55.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:55.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:55.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:55.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:55.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:55.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:55.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:55.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:55.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:57.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:49:57.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:57.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:57.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:57.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:57.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:57.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:57.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:57.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:57.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:57.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:57.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:58.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:58.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:49:58.449 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:49:58.448+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:49:58.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:58.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:58.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:58.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:58.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:58.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:58.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:58.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:58.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:58.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:59.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:49:59.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:59.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:59.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:59.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:49:59.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:49:59.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:59.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:49:59.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:59.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:49:59.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:49:59.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:49:59.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:49:59.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:49:59.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:49:59.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:49:59.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:01.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:01.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:01.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:01.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:01.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:01.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:01.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:01.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:01.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:01.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:01.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:01.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:01.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:01.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:01.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:01.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:02.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:02.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:02.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:02.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:02.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:02.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:02.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:02.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:02.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:02.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:02.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:02.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:02.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:02.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:02.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:02.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:02.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:02.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:02.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:02.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:02.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:03.005 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:50:03.005 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:50:03.015 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:50:03.022 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:50:03.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:03.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:03.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:03.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:04.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:04.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:04.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:04.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:04.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:04.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:04.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:04.249 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:50:04.249 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:50:04.250 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455404 2023-09-23T07:50:04.250 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455404 -le 1695457101 ]] 2023-09-23T07:50:04.251 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:50:04.251 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:50:04.251 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:50:04.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:04.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:04.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:04.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:04.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:04.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:04.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:04.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:04.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:04.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:04.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:04.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:04.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:04.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:04.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:05.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:05.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:05.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:05.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:05.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:05.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:05.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:05.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:05.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:05.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:05.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:05.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:05.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:05.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:05.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:05.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:05.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:05.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:05.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:06.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:06.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:06.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:06.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:06.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:06.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:06.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:06.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:06.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:06.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:06.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:06.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:06.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:07.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:07.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:07.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:07.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:07.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:07.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:07.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:07.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:07.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:07.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:07.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:07.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:07.630 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:07.628+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:50:07.630 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:07.628+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:50:07.630 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:07.628+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:50:08.782 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:08.776+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:50:08.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:08.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:08.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:08.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:08.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:08.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:08.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:08.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:09.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:09.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:09.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:09.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:09.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:09.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:09.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:09.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:09.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:09.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:09.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:09.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:09.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:09.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:09.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:09.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:09.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:09.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:11.102 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:11.096+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:50:11.102 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:11.096+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:50:11.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:11.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:11.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:11.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:11.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:11.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:11.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:11.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:11.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:11.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:11.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:11.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:12.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:12.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:12.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:12.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:12.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:12.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:12.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:12.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:12.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:12.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:12.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:12.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:12.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:13.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:13.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:13.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:13.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:13.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:13.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:13.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:13.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:13.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:13.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:13.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:13.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:14.258 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:50:14.263 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:50:14.263 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:50:14.263 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:50:14.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:14.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:14.629 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:14.628+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:50:14.629 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:14.628+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:50:14.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:14.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:14.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:14.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:14.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:14.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:14.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:14.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:14.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:14.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:15.834 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:50:15.834 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:50:15.835 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455415 2023-09-23T07:50:15.835 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455415 -le 1695457101 ]] 2023-09-23T07:50:15.835 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:50:15.835 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:50:15.835 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:50:16.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:16.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:16.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:16.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:16.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:16.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:16.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:16.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:16.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:16.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:16.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:16.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:16.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:16.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:16.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:16.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:17.364 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:17.364+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:50:17.365 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:17.364+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:50:17.834 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:17.832+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:50:17.835 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:17.832+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:50:18.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:18.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:18.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:18.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:18.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:18.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:18.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:18.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:18.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:18.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:18.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:18.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:21.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:21.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:21.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:21.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:21.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:21.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:21.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:21.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:21.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:21.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:21.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:21.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:21.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:21.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:21.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:21.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:21.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:21.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:50:21.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:21.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:21.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:21.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:21.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:21.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:21.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:21.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:21.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:21.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:21.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:22.145 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:22.144+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:50:22.145 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:22.144+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:50:22.145 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:22.144+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:50:24.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:24.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:24.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:24.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:24.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:24.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:24.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:24.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:24.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:24.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:24.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:24.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:24.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:24.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:24.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:24.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:24.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:24.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:24.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:24.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:25.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:25.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:25.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:25.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:25.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:25.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:25.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:25.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:25.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:25.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:25.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:25.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:25.846 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:50:25.848 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:50:25.855 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:50:25.868 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:50:26.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:26.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:26.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:26.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:26.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:26.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:26.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:26.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:26.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:26.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:26.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:26.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:26.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:26.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:26.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:26.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:26.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:26.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:26.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:26.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:26.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:26.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:26.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:26.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:26.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:26.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:26.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:26.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:26.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:26.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:26.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:27.332 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:50:27.332 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:50:27.333 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455427 2023-09-23T07:50:27.333 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455427 -le 1695457101 ]] 2023-09-23T07:50:27.333 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:50:27.334 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:50:27.334 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:50:27.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:27.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:27.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:27.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:27.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:27.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:27.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:27.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:27.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:27.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:27.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:27.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:27.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:27.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:27.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:27.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:27.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:27.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:28.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:50:28.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:28.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:28.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:28.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:28.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:28.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:28.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:28.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:28.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:28.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:28.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:28.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:29.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:29.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:29.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:29.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:29.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:29.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:29.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:29.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:29.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:29.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:50:29.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:29.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:29.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:29.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:29.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:29.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:50:29.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:29.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:29.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:29.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:29.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:29.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:29.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:29.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:29.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:29.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:29.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:29.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:29.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:29.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:29.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:29.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:29.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:29.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:29.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:30.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:30.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:30.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:30.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:30.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:30.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:30.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:30.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:30.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:30.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:30.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:30.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:30.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:30.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:30.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:30.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:31.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:31.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:31.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:31.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:31.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:31.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:31.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:31.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:31.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:31.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:31.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:31.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:31.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:31.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:31.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:31.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:31.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:31.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:36.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:36.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:36.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:36.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:36.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:36.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:36.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:36.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:36.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:36.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:36.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:36.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:36.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:36.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:36.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:36.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:36.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:36.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:36.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:37.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:37.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:37.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:37.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:37.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:37.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:37.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:37.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:37.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:37.347 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:50:37.350 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:50:37.352 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:50:37.357 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:50:37.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:37.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:37.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:37.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:37.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:37.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:37.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:37.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:37.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:37.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:37.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:38.861 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:50:38.861 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:50:38.862 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455438 2023-09-23T07:50:38.862 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455438 -le 1695457101 ]] 2023-09-23T07:50:38.862 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:50:38.862 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:50:38.862 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:50:39.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:39.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:39.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:39.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:39.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:39.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:39.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:39.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:39.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:39.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:39.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:39.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:39.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:39.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:39.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:39.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:39.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:39.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:39.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:39.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:39.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:39.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:40.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:40.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:40.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:40.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:40.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:40.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:40.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:40.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:40.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:40.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:40.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:40.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:40.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:40.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:40.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:40.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:40.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:40.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:43.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:43.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:43.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:43.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:43.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:43.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:43.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:43.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:43.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:43.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:43.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:43.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:43.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:43.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:43.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:43.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:43.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:43.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:43.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:44.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:44.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:44.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:44.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:44.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:44.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:44.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:44.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:44.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:44.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:46.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:46.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:46.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:46.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:46.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:46.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:46.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:46.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:46.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:46.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:46.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:46.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:46.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:46.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:46.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:46.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:47.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:47.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:47.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:47.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:47.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:47.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:47.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:47.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:47.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:47.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:47.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:47.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:47.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:47.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:47.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:47.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:47.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:47.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:47.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:47.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:48.869 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:50:48.869 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:50:48.870 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:50:48.873 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:50:49.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:49.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:49.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:49.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:49.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:49.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:49.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:49.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:49.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:49.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:49.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:49.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:49.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:49.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:49.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:49.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:49.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:49.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:49.311 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:49.308+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:50:49.311 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:50:49.308+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:50:50.204 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:50:50.205 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:50:50.207 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455450 2023-09-23T07:50:50.207 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455450 -le 1695457101 ]] 2023-09-23T07:50:50.207 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:50:50.207 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:50:50.207 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:50:51.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:51.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:51.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:51.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:51.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:51.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:51.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:51.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:51.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:51.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:51.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:51.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:51.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:51.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:51.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:51.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:51.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:51.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:51.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:51.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:52.626 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:50:52.624+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:50:53.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:53.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:50:53.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:53.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:53.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:53.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:53.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:53.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:50:53.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:53.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:53.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:53.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:53.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:53.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:53.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:53.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:53.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:53.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:53.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:53.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:50:55.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:55.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:50:55.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:55.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:55.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:55.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:55.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:55.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:55.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:55.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:55.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:55.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:55.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:55.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:55.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:55.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:58.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:58.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:50:58.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:58.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:50:58.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:58.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:50:58.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:58.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:50:58.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:58.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:50:58.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:58.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:50:58.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:58.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:50:58.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:50:58.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:00.222 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:51:00.225 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:51:00.226 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:51:00.229 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:51:00.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:51:00.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:00.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:00.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:00.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:00.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:00.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:00.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:00.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:00.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:00.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:00.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:00.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:01.039 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:01.035+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:51:01.039 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:01.035+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:51:01.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:01.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:01.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:01.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:01.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:01.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:01.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:01.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:01.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:01.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:01.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:01.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:01.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:01.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:01.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:01.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:01.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:01.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:01.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:01.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:01.837 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:51:01.845 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:51:01.846 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455461 2023-09-23T07:51:01.846 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455461 -le 1695457101 ]] 2023-09-23T07:51:01.846 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:51:01.846 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:51:01.846 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:51:06.304 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:06.299+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:51:06.337 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:06.335+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:51:06.337 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:06.335+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:51:06.337 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:06.335+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:51:06.850 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:06.847+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:51:06.850 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:06.847+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:51:06.850 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:06.847+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:51:07.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:07.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:07.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:07.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:07.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:07.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:07.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:07.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:07.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:07.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:07.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:07.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:07.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:07.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:07.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:07.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:07.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:07.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:07.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:07.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:09.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:51:09.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:09.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:09.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:09.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:09.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:09.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:09.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:09.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:09.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:09.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:51:09.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:09.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:09.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:09.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:09.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:09.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:09.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:09.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:09.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:09.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:09.911 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:09.907+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:51:09.911 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:09.907+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:51:09.911 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:09.907+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:51:09.925 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:09.923+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:51:09.926 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:09.923+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:51:09.926 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:09.923+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:51:11.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:11.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:11.135 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:11.127+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:51:11.135 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:11.127+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:51:11.135 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:11.127+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:51:11.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:11.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:11.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:11.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:11.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:11.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:11.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:11.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:11.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:11.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:11.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:11.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:11.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:11.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:11.848 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:51:11.850 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:51:11.850 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:51:11.856 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:51:12.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:12.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:12.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:12.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:12.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:12.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:12.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:12.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:12.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:12.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:12.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:12.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:12.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:12.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:12.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:13.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:13.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:13.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:13.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:13.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:13.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:13.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:13.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:13.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:13.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:13.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:13.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:13.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:13.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:13.136 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:51:13.137 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:51:13.138 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455473 2023-09-23T07:51:13.138 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455473 -le 1695457101 ]] 2023-09-23T07:51:13.138 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:51:13.138 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:51:13.138 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:51:15.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:15.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:15.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:15.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:15.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:15.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:15.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:15.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:15.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:15.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:15.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:15.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:16.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:16.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:16.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:16.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:16.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:16.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:16.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:16.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:16.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:16.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:16.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:16.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:17.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:17.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:18.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:18.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:18.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:18.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:18.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:18.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:18.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:18.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:18.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:18.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:18.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:18.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:18.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:18.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:18.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:18.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:18.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:18.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:18.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:18.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:18.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:18.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:18.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:18.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:18.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:18.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:18.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:21.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:21.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:21.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:21.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:21.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:21.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:21.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:21.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:21.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:21.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:21.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:21.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:21.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:21.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:21.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:21.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:21.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:21.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:21.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:21.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:22.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:22.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:22.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:22.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:22.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:22.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:22.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:22.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:22.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:22.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:22.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:22.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:22.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:22.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:22.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:22.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:23.141 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:51:23.141 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:51:23.141 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:51:23.143 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:51:24.757 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:51:24.757 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:51:24.757 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455484 2023-09-23T07:51:24.758 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455484 -le 1695457101 ]] 2023-09-23T07:51:24.758 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:51:24.758 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:51:24.758 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:51:24.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:24.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:24.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:24.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:24.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:24.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:24.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:24.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:24.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:24.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:24.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:24.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:24.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:24.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:24.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:24.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:24.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:24.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:25.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:25.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:25.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:25.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:25.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:25.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:25.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:25.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:25.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:25.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:25.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:25.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:25.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:25.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:25.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:25.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:25.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:25.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:27.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:27.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:27.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:27.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:27.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:27.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:27.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:27.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:27.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:27.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:27.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:27.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:28.700 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:28.695+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:51:28.700 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:28.695+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:51:28.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:28.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:28.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:28.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:28.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:28.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:28.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:28.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:29.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:29.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:29.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:29.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:29.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:29.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:29.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:29.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:29.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:29.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:29.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:29.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:29.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:29.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:29.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:29.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:29.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:29.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:29.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:29.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:29.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:31.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:31.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:31.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:31.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:31.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:31.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:31.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:31.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:31.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:31.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:31.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:31.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:31.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:31.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:31.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:31.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:31.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:31.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:31.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:31.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:32.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:32.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:32.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:32.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:32.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:32.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:32.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:32.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:32.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:32.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:32.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:32.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:32.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:32.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:32.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:32.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:32.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:32.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:32.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:32.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:32.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:51:32.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:32.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:32.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:32.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:32.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:32.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:32.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:32.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:32.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:32.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:32.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:32.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:32.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:32.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:32.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:32.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:32.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:32.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:32.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:32.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:32.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:32.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:32.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:32.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:32.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:32.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:32.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:32.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:32.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:32.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:34.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:34.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:34.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:34.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:34.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:34.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:34.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:34.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:34.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:34.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:34.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:34.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:34.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:34.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:34.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:34.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:34.766 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:51:34.767 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:51:34.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:34.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:34.771 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:51:34.775 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:51:34.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:34.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:35.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:35.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:35.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:35.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:35.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:35.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:35.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:35.358 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:35.351+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:51:35.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:35.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:35.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:35.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:35.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:35.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:35.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:35.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:35.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:35.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:35.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:35.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:35.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:35.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:36.336 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:51:36.339 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:51:36.340 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455496 2023-09-23T07:51:36.340 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455496 -le 1695457101 ]] 2023-09-23T07:51:36.340 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:51:36.340 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:51:36.340 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:51:38.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:38.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:38.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:38.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:38.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:38.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:38.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:38.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:38.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:38.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:38.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:38.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:38.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:38.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:38.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:38.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:38.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:38.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:38.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:38.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:38.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:38.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:38.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:38.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:38.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:38.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:38.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:38.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:38.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:38.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:38.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:38.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:40.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:40.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:40.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:40.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:40.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:40.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:40.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:40.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:40.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:40.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:40.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:40.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:40.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:40.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:40.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:40.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:41.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:41.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:41.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:41.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:41.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:41.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:41.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:41.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:41.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:41.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:41.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:41.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:41.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:41.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:41.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:41.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:41.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:41.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:41.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:41.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:42.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:42.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:42.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:42.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:42.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:42.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:42.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:42.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:42.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:42.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:42.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:42.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:42.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:42.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:42.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:42.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:42.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:42.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:43.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:43.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:43.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:43.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:43.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:43.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:43.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:43.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:43.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:43.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:43.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:43.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:43.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:44.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:44.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:44.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:44.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:44.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:44.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:44.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:44.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:44.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:44.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:44.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:44.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:44.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:44.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:44.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:44.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:44.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:44.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:45.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:45.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:45.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:45.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:45.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:45.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:45.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:45.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:45.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:45.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:45.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:45.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:45.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:45.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:45.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:45.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:45.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:45.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:45.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:46.347 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:51:46.347 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:51:46.347 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:51:46.352 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:51:46.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:46.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:46.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:46.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:46.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:46.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:46.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:46.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:47.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:47.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:47.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:47.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:47.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:47.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:47.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:47.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:47.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:47.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:47.540 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:51:47.540 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:51:47.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455507 2023-09-23T07:51:47.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455507 -le 1695457101 ]] 2023-09-23T07:51:47.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:51:47.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:51:47.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:51:48.686 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:48.683+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:51:48.686 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:48.683+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:51:48.686 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:51:48.683+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:51:49.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:49.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:49.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:49.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:49.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:49.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:49.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:49.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:49.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:49.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:49.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:49.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:49.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:49.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:49.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:49.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:50.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:51:50.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:50.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:50.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:50.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:50.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:50.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:50.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:50.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:50.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:50.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:50.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:50.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:51:50.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:50.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:50.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:50.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:50.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:50.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:50.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:50.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:50.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:50.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:50.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:50.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:50.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:50.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:50.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:50.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:50.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:50.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:50.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:50.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:50.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:52.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:52.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:52.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:52.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:52.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:52.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:52.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:52.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:52.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:52.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:52.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:52.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:52.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:52.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:52.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:52.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:52.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:52.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:52.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:52.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:55.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:55.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:55.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:55.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:55.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:55.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:55.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:55.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:55.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:55.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:55.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:55.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:55.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:55.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:55.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:55.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:56.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:51:56.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:56.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:56.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:56.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:56.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:56.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:56.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:56.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:56.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:56.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:56.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:57.564 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:51:57.564 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:51:57.566 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:51:57.577 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:51:58.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:58.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:51:58.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:58.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:51:58.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:58.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:51:58.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:58.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:51:58.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:58.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:51:58.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:58.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:51:58.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:58.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:51:58.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:58.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:51:58.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:58.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:51:58.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:51:58.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:51:59.214 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:51:59.214 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:51:59.215 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455519 2023-09-23T07:51:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455519 -le 1695457101 ]] 2023-09-23T07:51:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:51:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:51:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:52:00.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:00.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:00.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:00.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:00.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:00.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:00.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:00.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:00.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:00.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:01.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:00.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:01.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:01.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:01.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:01.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:01.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:01.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:01.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:01.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:01.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:01.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:01.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:01.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:01.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:01.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:01.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:01.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:01.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:01.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:02.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:02.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:02.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:02.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:02.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:02.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:02.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:02.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:02.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:02.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:52:02.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:02.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:02.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:02.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:02.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:02.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:02.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:02.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:02.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:02.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:02.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:02.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:05.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:05.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:05.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:05.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:05.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:05.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:05.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:07.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:07.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:07.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:07.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:07.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:07.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:07.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:07.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:07.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:07.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:07.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:07.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:07.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:07.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:07.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:07.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:07.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:07.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:09.222 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:52:09.244 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:52:09.244 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:52:09.264 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:52:10.024 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:52:10.018+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:52:10.024 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:52:10.018+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:52:10.530 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:52:10.549 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:52:10.550 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455530 2023-09-23T07:52:10.550 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455530 -le 1695457101 ]] 2023-09-23T07:52:10.550 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:52:10.550 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:52:10.550 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:52:14.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:14.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:14.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:14.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:14.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:14.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:14.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:14.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:14.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:14.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:14.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:14.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:14.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:14.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:14.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:14.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:14.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:14.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:16.085 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:52:16.078+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:52:16.085 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:52:16.078+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:52:16.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:16.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:16.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:16.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:16.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:16.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:16.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:16.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:16.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:16.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:16.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:16.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:19.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:19.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:19.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:19.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:19.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:19.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:19.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:19.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:19.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:19.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:19.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:52:19.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:19.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:19.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:19.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:20.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:20.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:20.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:20.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:20.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:20.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:20.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:20.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:20.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:20.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:20.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:20.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:20.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:20.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:20.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:20.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:20.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:20.552 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:52:20.552 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:52:20.562 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:52:20.562 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:52:20.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:20.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:20.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:20.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:20.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:20.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:20.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:20.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:20.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:20.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:20.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:21.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:21.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:21.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:21.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:21.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:21.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:21.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:21.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:21.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:21.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:21.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:21.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:21.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:21.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:21.852 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:52:21.863 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:52:21.864 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455541 2023-09-23T07:52:21.864 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455541 -le 1695457101 ]] 2023-09-23T07:52:21.864 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:52:21.864 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:52:21.864 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:52:22.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:22.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:22.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:22.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:23.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:23.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:23.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:23.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:23.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:23.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:23.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:23.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:23.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:52:23.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:23.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:23.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:23.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:23.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:23.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:23.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:23.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:23.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:23.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:23.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:23.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:23.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:23.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:23.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:23.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:23.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:23.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:23.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:23.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:26.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:26.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:26.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:26.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:26.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:26.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:26.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:26.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:26.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:26.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:26.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:26.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:26.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:26.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:26.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:26.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:26.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:26.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:27.277 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:52:27.274+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:52:27.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:27.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:27.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:27.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:27.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:27.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:27.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:27.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:27.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:27.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:27.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:27.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:27.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:27.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:28.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:28.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:28.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:28.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:28.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:28.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:28.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:28.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:28.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:28.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:28.543 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:52:28.538+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:52:28.544 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:52:28.538+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:52:28.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:28.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:28.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:28.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:28.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:28.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:28.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:28.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:28.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:28.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:29.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:29.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:29.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:29.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:29.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:29.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:29.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:29.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:29.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:52:29.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:29.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:29.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:29.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:29.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:29.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:29.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:29.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:29.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:30.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:30.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:30.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:30.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:30.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:30.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:30.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:30.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:30.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:30.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:30.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:30.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:30.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:30.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:30.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:30.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:31.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:30.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:31.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:30.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:31.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:31.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:31.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:31.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:31.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:31.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:31.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:31.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:31.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:31.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:31.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:31.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:31.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:31.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:31.869 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:52:31.869 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:52:31.882 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:52:31.884 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:52:32.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:32.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:32.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:32.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:32.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:32.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:32.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:32.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:32.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:32.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:32.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:32.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:32.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:32.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:33.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:33.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:33.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:33.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:33.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:33.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:33.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:33.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:33.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:33.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:33.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:33.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:33.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:33.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:33.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:33.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:33.307 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:52:33.307 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:52:33.308 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455553 2023-09-23T07:52:33.308 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455553 -le 1695457101 ]] 2023-09-23T07:52:33.308 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:52:33.308 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:52:33.308 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:52:34.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:34.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:34.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:34.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:34.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:34.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:34.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:34.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:34.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:34.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:34.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:34.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:35.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:35.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:35.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:35.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:35.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:35.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:35.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:35.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:35.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:35.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:35.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:35.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:35.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:35.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:35.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:35.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:35.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:35.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:37.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:37.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:37.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:37.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:37.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:37.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:37.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:37.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:37.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:37.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:37.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:37.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:37.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:37.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:37.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:37.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:37.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:37.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:37.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:37.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:39.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:39.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:39.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:39.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:39.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:39.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:39.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:39.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:39.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:39.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:39.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:39.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:42.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:42.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:42.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:42.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:42.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:42.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:42.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:42.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:42.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:42.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:42.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:42.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:42.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:42.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:42.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:42.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:43.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:43.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:43.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:43.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:43.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:43.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:43.311 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:52:43.312 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:52:43.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:43.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:43.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:43.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:43.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:43.363 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:52:43.366 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:52:43.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:43.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:43.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:43.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:43.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:43.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:43.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:43.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:43.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:43.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:44.493 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:52:44.493 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:52:44.494 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455564 2023-09-23T07:52:44.494 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455564 -le 1695457101 ]] 2023-09-23T07:52:44.494 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:52:44.495 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:52:44.495 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:52:45.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:45.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:45.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:45.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:45.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:45.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:45.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:45.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:45.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:45.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:45.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:45.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:45.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:45.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:45.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:45.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:45.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:45.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:46.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:46.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:46.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:46.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:46.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:46.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:46.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:46.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:46.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:46.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:46.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:46.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:52:46.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:46.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:46.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:46.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:46.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:46.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:46.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:46.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:46.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:46.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:46.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:49.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:49.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:49.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:49.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:49.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:49.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:49.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:49.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:49.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:49.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:49.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:49.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:49.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:49.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:49.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:49.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:49.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:49.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:49.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:49.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:52.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:52.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:52.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:52.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:52.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:52.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:52.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:52.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:52.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:52.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:52.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:52.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:52.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:52.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:52.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:52.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:52.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:52.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:53.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:53.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:53.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:53.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:53.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:53.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:53.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:53.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:53.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:53.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:53.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:54.502 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:52:54.502 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:52:54.512 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:52:54.512 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:52:54.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:54.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:54.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:54.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:54.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:54.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:54.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:54.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:54.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:54.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:54.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:54.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:54.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:54.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:54.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:54.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:55.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:55.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:55.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:55.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:52:55.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:52:55.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:52:55.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:52:55.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:52:55.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:52:55.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:52:55.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:52:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:52:55.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:52:55.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:52:55.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:52:55.917 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:52:55.922 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:52:55.928 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455575 2023-09-23T07:52:55.928 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455575 -le 1695457101 ]] 2023-09-23T07:52:55.928 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:52:55.928 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:52:55.928 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:53:01.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:01.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:01.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:01.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:01.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:01.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:01.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:01.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:01.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:01.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:01.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:01.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:02.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:02.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:02.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:02.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:02.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:02.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:02.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:02.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:02.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:02.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:02.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:02.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:03.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:03.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:03.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:03.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:03.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:03.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:03.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:03.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:03.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:03.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:03.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:03.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:05.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:05.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:05.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:05.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:05.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:05.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:05.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:05.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:05.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:05.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:53:05.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:05.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:05.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:05.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:05.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:05.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:05.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:05.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:05.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:05.948 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:53:05.948 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:53:05.948 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:53:05.969 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:53:06.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:06.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:06.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:06.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:06.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:06.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:06.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:06.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:06.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:06.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:06.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:06.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:06.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:06.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:06.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:06.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:06.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:06.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:06.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:06.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:07.294 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:53:07.294 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:53:07.295 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455587 2023-09-23T07:53:07.295 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455587 -le 1695457101 ]] 2023-09-23T07:53:07.295 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:53:07.295 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:53:07.295 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:53:07.405 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:53:07.405+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T07:53:07.405 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:53:07.405+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:53:08.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:08.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:08.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:08.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:08.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:08.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:08.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:08.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:08.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:08.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:08.321 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:53:08.317+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:53:08.321 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:53:08.317+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:53:08.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:08.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:08.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:08.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:08.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:08.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:08.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:08.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:08.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:08.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:08.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:09.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:09.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:09.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:09.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:09.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:09.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:09.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:09.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:09.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:09.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:09.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:09.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:09.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:09.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:09.194 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:53:09.193+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:53:09.194 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:53:09.193+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:53:09.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:09.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:09.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:09.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:11.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:11.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:11.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:11.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:11.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:11.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:11.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:11.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:11.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:11.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:11.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:11.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:11.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:11.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:11.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:11.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:11.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:11.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:11.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:11.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:11.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:11.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:13.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:13.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:13.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:13.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:13.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:13.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:13.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:13.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:13.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:13.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:13.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:13.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:13.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:13.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:13.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:13.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:13.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:13.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:13.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:13.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:13.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:13.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:14.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:14.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:14.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:14.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:14.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:14.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:14.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:14.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:14.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:14.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:14.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:14.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:14.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:14.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:14.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:14.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:14.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:14.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:16.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:16.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:16.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:16.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:16.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:16.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:16.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:16.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:16.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:16.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:16.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:16.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:16.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:16.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:16.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:16.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:17.316 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:53:17.319 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:53:17.319 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:53:17.348 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:53:17.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:17.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:17.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:17.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:17.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:17.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:17.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:17.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:17.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:17.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:17.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:17.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:17.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:17.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:17.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:17.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:17.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:18.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:18.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:18.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:18.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:18.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:18.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:18.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:18.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:18.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:18.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:18.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:18.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:18.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:18.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:18.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:18.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:18.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:18.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:18.474 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:53:18.474 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:53:18.475 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455598 2023-09-23T07:53:18.475 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455598 -le 1695457101 ]] 2023-09-23T07:53:18.475 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:53:18.475 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:53:18.475 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:53:23.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:23.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:23.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:23.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:23.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:23.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:23.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:23.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:23.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:23.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:23.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:23.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:23.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:23.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:23.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:23.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:23.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:23.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:23.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:23.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:24.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:24.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:24.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:24.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:24.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:24.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:24.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:24.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:24.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:24.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:24.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:24.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:24.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:24.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:24.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:24.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:24.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:24.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:25.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:25.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:25.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:25.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:25.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:25.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:25.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:25.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:26.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:26.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:26.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:26.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:26.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:26.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:26.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:26.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:26.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:26.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:26.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:26.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:26.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:26.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:26.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:26.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:26.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:26.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:26.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:26.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:26.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:26.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:26.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:26.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:26.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:26.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:26.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:26.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:27.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:27.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:27.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:27.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:27.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:27.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:27.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:27.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:27.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:27.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:27.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:27.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:27.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:27.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:27.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:27.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:27.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:27.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:28.486 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:53:28.487 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:53:28.487 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:53:28.487 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:53:29.835 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:53:29.836 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:53:29.836 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455609 2023-09-23T07:53:29.836 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455609 -le 1695457101 ]] 2023-09-23T07:53:29.837 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:53:29.837 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:53:29.837 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:53:30.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:30.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:30.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:30.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:30.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:30.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:30.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:30.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:30.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:30.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:30.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:30.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:30.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:30.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:30.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:30.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:30.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:30.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:32.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:32.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:32.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:32.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:32.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:32.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:32.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:32.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:32.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:32.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:32.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:32.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:32.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:32.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:32.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:32.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:33.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:33.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:33.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:33.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:33.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:33.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:33.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:33.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:33.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:33.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:33.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:33.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:33.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:33.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:33.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:33.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:33.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:33.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:33.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:33.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:33.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:33.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:33.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:33.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:33.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:33.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:33.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:33.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:33.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:33.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:33.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:33.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:33.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:34.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:33.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:34.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:34.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:34.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:34.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:34.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:34.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:34.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:34.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:34.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:34.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:34.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:34.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:34.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:34.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:34.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:34.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:34.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:34.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:36.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:36.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:36.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:36.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:36.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:36.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:36.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:36.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:36.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:36.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:36.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:36.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:36.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:36.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:36.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:36.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:36.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:36.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:36.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:36.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:36.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:36.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:36.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:36.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:36.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:36.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:36.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:36.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:36.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:36.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:36.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:37.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:37.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:37.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:37.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:37.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:37.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:37.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:37.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:37.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:37.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:37.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:37.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:37.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:37.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:37.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:37.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:37.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:39.298 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:53:39.296+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:53:39.298 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:53:39.296+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:53:39.298 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:53:39.296+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:53:39.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:39.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:39.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:39.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:39.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:39.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:39.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:39.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:39.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:39.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:39.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:39.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:39.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:39.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:39.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:39.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:39.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:39.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:39.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:39.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:39.853 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:53:39.859 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:53:39.865 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:53:39.867 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:53:41.091 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:53:41.102 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:53:41.103 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455621 2023-09-23T07:53:41.104 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455621 -le 1695457101 ]] 2023-09-23T07:53:41.104 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:53:41.104 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:53:41.104 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:53:42.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:42.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:42.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:42.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:42.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:42.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:42.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:42.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:42.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:42.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:42.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:42.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:42.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:42.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:42.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:42.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:42.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:42.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:43.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:43.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:43.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:43.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:43.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:43.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:43.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:43.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:43.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:43.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:43.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:43.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:43.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:43.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:43.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:43.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:43.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:43.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:43.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:43.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:44.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:44.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:44.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:44.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:44.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:44.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:44.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:44.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:44.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:44.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:44.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:44.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:44.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:44.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:44.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:44.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:44.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:44.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:44.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:45.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:45.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:45.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:45.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:45.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:45.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:45.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:45.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:45.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:45.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:45.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:45.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:45.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:45.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:45.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:45.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:45.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:45.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:46.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:46.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:46.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:46.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:46.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:46.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:46.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:46.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:46.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:46.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:46.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:46.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:46.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:46.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:46.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:46.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:48.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:48.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:48.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:48.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:48.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:48.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:49.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:49.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:49.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:49.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:49.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:49.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:49.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:49.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:49.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:49.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:50.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:53:50.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:50.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:50.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:50.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:50.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:50.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:50.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:50.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:50.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:50.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:50.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:50.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:51.112 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:53:51.113 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:53:51.117 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:53:51.131 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:53:51.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:53:51.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:53:51.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:51.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:51.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:51.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:51.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:51.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:51.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:51.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:51.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:51.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:51.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:52.558 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:53:52.559 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:53:52.559 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455632 2023-09-23T07:53:52.559 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455632 -le 1695457101 ]] 2023-09-23T07:53:52.559 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:53:52.559 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:53:52.559 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:53:53.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:53.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:53.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:53.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:53.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:53.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:53.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:53.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:53.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:53.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:53.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:53.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:53.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:53.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:53.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:53.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:54.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:54.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:54.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:54.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:54.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:54.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:54.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:54.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:54.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:54.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:54.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:54.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:54.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:54.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:54.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:54.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:54.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:54.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:57.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:57.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:57.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:57.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:57.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:57.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:57.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:57.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:57.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:57.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:57.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:57.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:57.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:57.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:57.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:57.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:58.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:58.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:53:58.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:58.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:58.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:58.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:58.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:58.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:58.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:58.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:58.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:58.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:58.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:58.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:58.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:58.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:53:59.357 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:53:59.352+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:53:59.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:59.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:53:59.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:59.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:53:59.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:59.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:53:59.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:59.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:53:59.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:59.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:53:59.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:59.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:53:59.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:59.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:53:59.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:59.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:53:59.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:59.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:53:59.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:53:59.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:02.561 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:54:02.562 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:54:02.587 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:54:02.599 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:54:03.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:03.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:03.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:03.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:03.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:03.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:03.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:03.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:03.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:03.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:03.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:03.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:03.845 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:54:03.847 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:54:03.860 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455643 2023-09-23T07:54:03.860 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455643 -le 1695457101 ]] 2023-09-23T07:54:03.860 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:54:03.860 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:54:03.860 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:54:05.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:05.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:05.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:05.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:05.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:05.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:05.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:05.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:05.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:54:05.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:05.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:05.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:05.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:05.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:05.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:05.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:05.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:06.600 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:06.592+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:54:06.600 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:06.592+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:54:08.445 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:08.444+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:54:08.487 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:08.480+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:54:09.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:09.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:09.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:09.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:09.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:09.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:09.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:09.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:09.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:09.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:09.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:09.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:09.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:09.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:09.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:09.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:09.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:09.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:09.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:09.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:09.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:09.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:09.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:09.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:09.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:09.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:09.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:09.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:09.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:11.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:11.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:11.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:11.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:11.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:11.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:11.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:11.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:11.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:11.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:11.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:11.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:11.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:11.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:11.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:11.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:11.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:11.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:12.026 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:12.020+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:54:12.026 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:12.020+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:54:12.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:12.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:12.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:12.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:12.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:12.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:12.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:12.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:12.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:12.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:12.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:54:12.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:12.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:12.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:12.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:12.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:12.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:12.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:12.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:12.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:12.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:12.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:54:12.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:12.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:12.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:12.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:12.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:12.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:12.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:12.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:12.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:12.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:12.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:12.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:13.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:13.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:13.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:13.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:13.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:13.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:13.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:13.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:13.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:13.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:13.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:13.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:13.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:13.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:13.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:13.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:13.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:13.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:13.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:13.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:13.873 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:54:13.880 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:54:13.893 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:54:13.893 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:54:14.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:14.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:14.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:14.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:14.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:14.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:14.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:14.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:14.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:14.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:14.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:14.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:14.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:14.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:14.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:14.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:14.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:14.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:15.107 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:15.104+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:54:15.122 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:15.120+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:54:15.122 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:15.120+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:54:15.212 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455655 2023-09-23T07:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455655 -le 1695457101 ]] 2023-09-23T07:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:54:15.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:54:15.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:54:16.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:16.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:16.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:16.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:16.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:16.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:16.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:16.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:16.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:16.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:54:16.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:16.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:16.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:16.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:16.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:16.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:16.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:16.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:16.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:16.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:16.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:16.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:17.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:17.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:17.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:17.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:17.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:17.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:17.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:17.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:17.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:17.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:17.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:17.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:17.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:17.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:17.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:17.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:17.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:17.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:17.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:17.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:19.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:19.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:19.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:19.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:19.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:19.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:19.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:19.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:19.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:19.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:19.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:19.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:19.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:19.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:19.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:19.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:19.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:19.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:20.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:20.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:20.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:20.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:20.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:20.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:20.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:20.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:20.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:20.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:20.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:20.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:20.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:20.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:20.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:20.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:20.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:20.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:20.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:20.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:21.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:21.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:54:21.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:21.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:21.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:21.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:21.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:21.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:21.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:21.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:21.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:21.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:21.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:21.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:21.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:21.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:21.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:21.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:21.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:21.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:23.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:23.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:23.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:23.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:23.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:23.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:23.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:23.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:23.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:23.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:23.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:23.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:23.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:23.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:23.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:23.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:23.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:23.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:23.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:24.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:24.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:24.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:24.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:24.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:24.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:24.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:24.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:24.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:24.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:24.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:24.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:24.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:24.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:24.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:24.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:25.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:25.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:25.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:25.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:25.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:25.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:25.224 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:54:25.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:25.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:25.234 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:54:25.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:25.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:25.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:25.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:25.249 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:54:25.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:25.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:25.260 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:54:25.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:25.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:25.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:25.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:26.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:26.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:26.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:26.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:26.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:26.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:26.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:26.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:26.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:26.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:26.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:26.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:26.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:26.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:26.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:26.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:26.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:26.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:26.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:26.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:26.446 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:54:26.461 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:54:26.476 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455666 2023-09-23T07:54:26.476 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455666 -le 1695457101 ]] 2023-09-23T07:54:26.476 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:54:26.476 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:54:26.476 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:54:29.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:29.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:29.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:29.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:29.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:29.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:29.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:29.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:29.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:29.710 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:29.707+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:54:29.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:29.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:29.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:29.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:29.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:29.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:29.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:29.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:31.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:31.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:31.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:31.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:31.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:31.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:32.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:31.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:32.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:32.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:32.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:32.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:32.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:32.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:32.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:32.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:32.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:32.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:33.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:33.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:33.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:33.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:33.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:33.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:33.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:33.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:33.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:33.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:33.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:33.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:33.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:33.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:33.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:33.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:33.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:33.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:33.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:33.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:34.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:34.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:34.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:34.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:34.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:34.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:34.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:34.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:34.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:34.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:34.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:34.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:34.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:34.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:34.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:34.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:34.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:34.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:34.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:34.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:36.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:36.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:36.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:36.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:36.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:36.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:36.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:36.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:36.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:36.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:36.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:36.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:36.493 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:54:36.497 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:54:36.497 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:54:36.509 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:54:37.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:54:37.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:37.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:37.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:37.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:37.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:37.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:37.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:37.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:37.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:37.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:37.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:37.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:37.783 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:54:37.793 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:54:37.794 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455677 2023-09-23T07:54:37.794 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455677 -le 1695457101 ]] 2023-09-23T07:54:37.794 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:54:37.794 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:54:37.794 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:54:40.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:40.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:40.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:40.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:40.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:40.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:40.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:40.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:40.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:40.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:40.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:40.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:40.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:40.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:40.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:40.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:40.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:40.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:40.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:40.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:42.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:42.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:42.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:42.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:42.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:42.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:42.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:42.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:42.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:42.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:42.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:42.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:54:42.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:42.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:42.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:42.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:42.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:42.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:42.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:42.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:42.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:42.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:42.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:42.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:43.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:43.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:43.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:43.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:43.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:43.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:43.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:43.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:43.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:43.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:43.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:43.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:43.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:43.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:43.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:43.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:43.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:43.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:43.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:43.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:44.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:44.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:44.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:44.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:44.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:44.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:44.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:44.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:44.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:44.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:44.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:44.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:45.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:45.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:45.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:45.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:45.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:45.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:45.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:45.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:45.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:45.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:45.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:45.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:45.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:45.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:45.447 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:45.443+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:54:45.447 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:45.443+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:54:45.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:45.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:46.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:46.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:46.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:46.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:46.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:46.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:46.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:46.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:46.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:46.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:46.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:46.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:46.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:46.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:47.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:47.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:47.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:47.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:47.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:47.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:47.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:47.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:47.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:47.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:47.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:47.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:47.796 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:54:47.799 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:54:47.801 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:54:47.809 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:54:49.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:49.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:49.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:49.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:49.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:49.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:49.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:49.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:49.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:49.225 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:54:49.231 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:54:49.232 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455689 2023-09-23T07:54:49.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455689 -le 1695457101 ]] 2023-09-23T07:54:49.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:54:49.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:54:49.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:54:49.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:54:49.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:49.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:49.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:49.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:49.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:49.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:49.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:49.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:49.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:49.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:49.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:49.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:50.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:50.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:50.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:50.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:50.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:50.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:50.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:50.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:50.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:50.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:50.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:50.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:50.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:50.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:50.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:50.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:50.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:50.559 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:50.555+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:54:50.570 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:50.567+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:54:50.574 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:50.571+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:54:50.574 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:50.571+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:54:50.574 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:50.571+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:54:50.712 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:50.707+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:54:50.712 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:54:50.707+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:54:51.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:51.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:51.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:51.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:51.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:51.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:51.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:51.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:51.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:51.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:51.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:51.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:51.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:51.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:51.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:51.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:51.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:51.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:53.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:53.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:53.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:53.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:53.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:53.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:53.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:53.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:53.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:53.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:53.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:53.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:53.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:53.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:53.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:53.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:54.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:54.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:54.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:54.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:54.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:54.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:54.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:54.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:54.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:54.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:54.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:54.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:54.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:54.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:54.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:54.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:54.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:54.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:54.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:54.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:54.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:54.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:54.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:54.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:54.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:54.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:54.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:54.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:54.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:54.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:54.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:54.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:54.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:55.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:55.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:55.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:55.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:55.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:55.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:55.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:55.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:55.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:55.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:55.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:55.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:55.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:55.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:55.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:55.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:56.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:56.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:56.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:56.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:56.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:56.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:56.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:56.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:56.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:56.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:57.122 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:54:57.119+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:54:59.237 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:54:59.248 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:54:59.257 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:54:59.270 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:54:59.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:54:59.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:54:59.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:54:59.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:54:59.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:54:59.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:54:59.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:54:59.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:54:59.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:54:59.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:54:59.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:54:59.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:54:59.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:54:59.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:00.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:00.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:00.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:00.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:00.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:00.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:00.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:00.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:00.746 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:55:00.746 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:55:00.749 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455700 2023-09-23T07:55:00.749 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455700 -le 1695457101 ]] 2023-09-23T07:55:00.749 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:55:00.749 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:55:00.749 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:55:00.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:00.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:00.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:01.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:00.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:01.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:01.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:01.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:01.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:01.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:01.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:55:01.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:01.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:01.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:01.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:01.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:01.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:01.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:01.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:01.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:01.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:01.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:01.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:02.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:02.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:02.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:02.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:02.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:02.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:02.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:02.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:02.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:02.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:02.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:02.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:02.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:02.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:02.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:02.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:02.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:02.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:02.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:02.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:04.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:04.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:04.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:04.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:04.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:04.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:04.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:04.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:04.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:04.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:04.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:04.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:05.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:05.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:05.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:05.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:05.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:05.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:05.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:05.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:05.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:05.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:05.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:05.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:06.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:06.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:06.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:06.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:06.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:06.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:06.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:06.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:06.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:06.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:06.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:06.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:06.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:06.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:06.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:06.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:06.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:06.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:06.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:06.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:07.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:07.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:07.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:07.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:07.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:07.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:07.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:07.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:07.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:07.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:07.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:07.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:07.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:07.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:07.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:07.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:07.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:07.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:08.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:08.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:08.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:08.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:08.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:08.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:08.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:08.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:08.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:08.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:08.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:08.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:08.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:08.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:08.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:08.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:08.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:08.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:09.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:08.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:09.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:09.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:09.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:09.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:09.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:09.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:09.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:09.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:09.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:09.358 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:09.355+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:55:09.358 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:09.355+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:55:09.358 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:09.355+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:55:09.746 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:09.739+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:55:09.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:09.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:09.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:09.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:09.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:09.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:10.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:10.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:09.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:10.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:10.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:10.622 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:10.619+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:55:10.622 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:10.619+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:55:10.622 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:10.619+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:55:10.755 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:55:10.755 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:55:10.755 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:55:10.768 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:55:12.440 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:55:12.442 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:55:12.443 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455712 2023-09-23T07:55:12.443 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455712 -le 1695457101 ]] 2023-09-23T07:55:12.443 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:55:12.443 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:55:12.443 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:55:12.453 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:12.447+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:55:12.453 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:12.447+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:55:12.453 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:12.447+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:55:12.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:12.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:12.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:12.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:12.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:12.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:12.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:12.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:12.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:12.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:12.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:12.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:12.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:12.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:12.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:12.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:12.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:12.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:12.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:12.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:13.097 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:13.095+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:55:16.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:16.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:16.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:16.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:16.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:16.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:16.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:16.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:16.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:16.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:16.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:16.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:16.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:16.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:17.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:17.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:17.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:17.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:17.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:17.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:17.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:17.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:17.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:17.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:17.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:17.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:19.337 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:19.331+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:55:20.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:55:20.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:20.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:20.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:20.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:20.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:20.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:20.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:20.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:20.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:20.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:20.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:20.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:21.675 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:21.670+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:55:21.676 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:21.670+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:55:21.676 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:21.670+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:55:21.676 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:21.670+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:55:22.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:22.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:22.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:22.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:22.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:22.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:22.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:22.466 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:55:22.467 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:55:22.478 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:55:22.479 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:55:22.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:22.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:22.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:22.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:22.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:22.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:22.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:22.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:22.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:22.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:22.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:23.996 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:55:23.996 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:55:23.997 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455723 2023-09-23T07:55:23.997 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455723 -le 1695457101 ]] 2023-09-23T07:55:23.997 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:55:23.998 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:55:23.998 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:55:25.600 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:25.594+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:55:25.600 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:25.594+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:55:27.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:27.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:27.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:27.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:27.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:27.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:27.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:27.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:27.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:27.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:27.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:27.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:27.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:27.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:27.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:27.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:27.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:27.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:28.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:28.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:28.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:28.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:28.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:28.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:28.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:28.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:28.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:28.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:28.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:28.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:28.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:28.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:28.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:28.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:28.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:28.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:28.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:28.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:29.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:29.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:29.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:29.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:30.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:30.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:30.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:30.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:30.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:30.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:30.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:30.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:30.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:30.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:30.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:30.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:30.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:30.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:30.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:30.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:30.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:30.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:30.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:30.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:31.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:31.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:31.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:31.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:31.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:31.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:31.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:31.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:31.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:31.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:31.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:31.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:31.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:31.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:31.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:31.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:31.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:31.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:31.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:32.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:31.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:32.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:32.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:32.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:32.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:32.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:32.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:32.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:32.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:32.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:32.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:32.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:32.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:32.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:32.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:32.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:32.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:32.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:32.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:32.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:32.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:34.000 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:55:34.001 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:55:34.026 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:55:34.026 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:55:34.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:34.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:34.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:34.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:34.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:34.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:34.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:34.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:34.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:34.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:34.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:34.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:35.546 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:55:35.547 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:55:35.547 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455735 2023-09-23T07:55:35.548 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455735 -le 1695457101 ]] 2023-09-23T07:55:35.548 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:55:35.548 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:55:35.548 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:55:35.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:35.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:35.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:35.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:35.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:35.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:35.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:35.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:35.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:35.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:35.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:35.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:35.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:35.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:35.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:35.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:35.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:35.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:35.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:35.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:36.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:36.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:36.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:36.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:36.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:36.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:36.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:36.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:36.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:36.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:36.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:36.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:36.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:36.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:36.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:36.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:36.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:38.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:38.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:38.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:38.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:38.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:38.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:38.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:38.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:38.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:38.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:38.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:38.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:38.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:38.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:38.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:38.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:38.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:38.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:39.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:39.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:39.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:39.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:39.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:39.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:39.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:39.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:39.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:39.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:39.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:39.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:39.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:39.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:39.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:39.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:39.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:39.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:40.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:40.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:40.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:40.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:40.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:40.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:40.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:40.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:40.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:40.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:40.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:40.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:40.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:40.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:41.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:41.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:41.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:41.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:41.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:41.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:41.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:41.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:41.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:41.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:41.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:41.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:41.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:41.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:41.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:41.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:41.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:41.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:41.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:41.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:41.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:42.116 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:42.110+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:55:42.117 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:42.110+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:55:42.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:42.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:42.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:42.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:42.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:42.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:42.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:42.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:42.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:42.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:42.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:42.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:42.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:42.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:42.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:42.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:42.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:42.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:55:42.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:42.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:42.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:42.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:42.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:42.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:43.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:43.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:43.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:43.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:43.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:43.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:43.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:43.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:43.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:43.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:43.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:43.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:43.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:43.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:43.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:43.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:43.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:43.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:43.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:43.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:45.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:45.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:45.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:45.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:45.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:45.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:45.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:45.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:45.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:45.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:45.556 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:55:45.557 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:55:45.568 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:55:45.575 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:55:45.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:45.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:45.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:45.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:45.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:45.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:45.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:45.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:46.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:46.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:46.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:46.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:46.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:46.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:46.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:46.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:46.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:46.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:46.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:46.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:46.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:46.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:46.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:46.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:46.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:46.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:46.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:46.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:46.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:46.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:46.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:46.986 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:55:46.990 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:55:46.991 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455746 2023-09-23T07:55:46.991 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455746 -le 1695457101 ]] 2023-09-23T07:55:46.991 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:55:46.991 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:55:46.991 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:55:47.305 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:47.298+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:55:47.305 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:47.298+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:55:47.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:47.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:47.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:47.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:47.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:47.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:47.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:47.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:47.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:47.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:47.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:47.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:47.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:47.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:47.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:47.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:47.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:47.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:47.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:48.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:48.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:48.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:48.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:48.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:48.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:48.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:48.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:48.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:48.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:48.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:48.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:48.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:48.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:48.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:48.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:48.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:48.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:48.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:48.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:49.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:49.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:49.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:49.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:49.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:49.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:49.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:49.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:49.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:49.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:49.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:49.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:49.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:49.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:49.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:49.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:49.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:49.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:50.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:50.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:50.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:50.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:50.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:50.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:50.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:50.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:50.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:50.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:50.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:50.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:51.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:51.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:51.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:51.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:51.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:51.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:51.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:51.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:51.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:51.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:51.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:51.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:51.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:51.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:52.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:55:52.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:52.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:52.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:52.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:52.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:52.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:52.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:52.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:52.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:52.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:52.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:52.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:53.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:53.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:55:53.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:53.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:53.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:53.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:53.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:53.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:53.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:53.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:53.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:53.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:53.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:53.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:53.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:53.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:54.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:54.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:54.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:54.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:54.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:54.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:54.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:54.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:54.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:54.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:54.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:54.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:54.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:54.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:54.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:54.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:54.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:54.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:57.006 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:55:57.008 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:55:57.009 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:55:57.039 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:55:58.092 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:55:58.086+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:55:58.227 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:55:58.227 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:55:58.230 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455758 2023-09-23T07:55:58.230 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455758 -le 1695457101 ]] 2023-09-23T07:55:58.230 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:55:58.230 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:55:58.230 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:55:59.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:55:59.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:59.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:59.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:59.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:59.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:55:59.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:55:59.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:55:59.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:55:59.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:55:59.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:55:59.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:55:59.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:55:59.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:55:59.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:55:59.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:01.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:01.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:01.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:01.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:01.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:01.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:01.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:01.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:01.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:01.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:01.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:01.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:03.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:03.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:03.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:03.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:03.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:03.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:03.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:03.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:03.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:03.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:03.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:03.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:03.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:03.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:03.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:03.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:03.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:04.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:04.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:04.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:04.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:04.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:04.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:04.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:04.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:04.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:04.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:04.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:04.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:04.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:04.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:04.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:04.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:04.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:04.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:04.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:04.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:05.788 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:05.782+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:56:05.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:05.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:05.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:05.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:05.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:05.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:05.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:05.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:05.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:05.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:05.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:05.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:05.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:05.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:05.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:05.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:05.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:05.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:05.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:05.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:06.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:06.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:06.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:06.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:06.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:06.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:06.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:06.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:06.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:06.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:06.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:06.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:06.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:06.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:06.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:06.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:06.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:06.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:06.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:06.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:08.237 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:56:08.237 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:56:08.242 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:56:08.243 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:56:09.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:09.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:09.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:09.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:09.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:09.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:09.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:09.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:09.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:09.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:09.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:09.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:09.700 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:56:09.700 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:56:09.702 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455769 2023-09-23T07:56:09.702 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455769 -le 1695457101 ]] 2023-09-23T07:56:09.702 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:56:09.702 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:56:09.702 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:56:11.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:11.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:11.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:11.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:11.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:11.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:11.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:11.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:11.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:11.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:11.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:11.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:11.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:11.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:11.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:11.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:11.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:11.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:11.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:11.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:12.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:12.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:12.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:12.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:12.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:12.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:12.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:12.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:12.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:12.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:12.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:12.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:12.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:12.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:14.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:14.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:14.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:14.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:14.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:14.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:14.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:14.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:14.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:14.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:14.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:14.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:14.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:14.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:15.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:15.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:15.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:15.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:15.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:15.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:15.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:15.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:15.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:15.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:15.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:15.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:15.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:15.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:15.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:15.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:16.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:16.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:16.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:16.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:16.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:16.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:16.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:16.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:16.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:16.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:16.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:16.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:18.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:18.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:18.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:18.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:18.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:18.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:18.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:18.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:18.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:18.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:18.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:18.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:18.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:18.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:18.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:18.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:18.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:18.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:18.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:18.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:56:18.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:18.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:18.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:18.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:18.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:18.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:18.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:18.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:18.969 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:18.966+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:56:18.969 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:18.966+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:56:18.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:18.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:19.706 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:56:19.706 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:56:19.713 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:56:19.720 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:56:20.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:20.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:20.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:20.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:20.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:20.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:20.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:20.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:20.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:20.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:20.903 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:56:20.903 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:56:20.904 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455780 2023-09-23T07:56:20.904 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455780 -le 1695457101 ]] 2023-09-23T07:56:20.904 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:56:20.904 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:56:20.904 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:56:20.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:20.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:20.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:20.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:20.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:20.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:20.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:20.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:22.442 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:22.437+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:56:22.442 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:22.437+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:56:22.442 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:22.437+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:56:22.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:22.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:22.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:22.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:22.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:22.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:22.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:22.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:22.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:22.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:22.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:22.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:22.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:22.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:22.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:22.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:22.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:22.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:22.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:22.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:23.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:23.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:23.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:23.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:23.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:23.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:23.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:23.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:23.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:23.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:23.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:23.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:23.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:23.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:23.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:23.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:23.746 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:23.745+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:56:23.746 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:23.745+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:56:24.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:24.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:24.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:24.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:24.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:24.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:24.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:24.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:24.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:24.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:24.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:24.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:24.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:24.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:24.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:24.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:24.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:24.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:24.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:24.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:26.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:26.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:26.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:26.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:26.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:26.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:26.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:26.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:26.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:26.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:26.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:26.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:26.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:26.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:26.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:26.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:26.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:26.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:26.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:26.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:27.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:27.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:28.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:28.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:28.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:28.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:28.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:28.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:28.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:28.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:28.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:28.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:28.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:28.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:28.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:28.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:28.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:28.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:28.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:28.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:28.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:28.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:30.906 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:56:30.906 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:56:30.906 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:56:30.940 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:56:31.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:31.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:31.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:31.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:31.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:31.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:31.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:31.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:31.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:31.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:31.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:31.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:31.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:31.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:31.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:31.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:31.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:31.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:31.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:31.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:32.063 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:56:32.077 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:56:32.079 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455792 2023-09-23T07:56:32.079 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455792 -le 1695457101 ]] 2023-09-23T07:56:32.079 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:56:32.079 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:56:32.079 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:56:32.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:32.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:32.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:32.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:32.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:32.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:32.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:32.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:32.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:32.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:32.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:32.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:32.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:32.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:32.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:32.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:32.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:32.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:32.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:32.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:34.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:34.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:34.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:34.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:34.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:34.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:34.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:34.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:34.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:34.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:34.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:34.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:34.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:34.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:34.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:34.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:34.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:34.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:36.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:36.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:36.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:36.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:36.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:36.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:36.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:36.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:36.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:36.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:36.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:36.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:36.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:36.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:38.250 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:38.249+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:56:38.250 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:38.249+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:56:38.251 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:38.249+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:56:39.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:39.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:40.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:40.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:40.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:40.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:40.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:40.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:40.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:40.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:40.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:40.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:40.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:40.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:40.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:40.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:40.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:40.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:40.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:40.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:40.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:40.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:40.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:40.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:40.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:40.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:40.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:40.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:40.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:40.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:40.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:40.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:40.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:41.358 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:41.353+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:56:41.358 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:41.353+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:56:41.358 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:41.353+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:56:42.085 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:56:42.085 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:56:42.085 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:56:42.087 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:56:42.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:42.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:42.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:42.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:42.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:42.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:42.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:42.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:42.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:42.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:42.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:42.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:42.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:42.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:42.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:42.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:42.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:42.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:43.258 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:56:43.261 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:56:43.262 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455803 2023-09-23T07:56:43.262 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455803 -le 1695457101 ]] 2023-09-23T07:56:43.262 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:56:43.262 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:56:43.262 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:56:43.362 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:43.357+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:56:43.362 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:43.357+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:56:44.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:44.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:44.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:44.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:44.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:44.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:44.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:44.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:44.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:44.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:44.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:44.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:44.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:44.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:44.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:44.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:44.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:44.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:44.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:44.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:44.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:44.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:44.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:44.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:44.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:44.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:44.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:46.450 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:56:46.445+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:56:47.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:56:47.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:47.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:47.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:47.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:47.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:47.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:47.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:47.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:47.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:47.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:47.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:49.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:49.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:49.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:49.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:49.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:49.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:49.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:49.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:49.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:49.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:49.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:49.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:49.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:49.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:49.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:49.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:51.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:51.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:51.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:51.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:51.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:51.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:51.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:51.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:51.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:51.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:51.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:51.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:51.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:51.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:51.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:51.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:51.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:51.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:51.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:51.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:52.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:52.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:52.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:52.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:52.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:52.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:52.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:52.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:52.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:52.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:52.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:52.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:52.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:52.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:52.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:52.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:52.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:52.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:53.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:53.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:53.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:53.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:53.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:53.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:53.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:53.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:53.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:53.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:53.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:53.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:53.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:53.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:53.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:53.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:53.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:53.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:53.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:53.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:53.264 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:56:53.264 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:56:53.280 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:56:53.301 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:56:54.597 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:56:54.597 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:56:54.598 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455814 2023-09-23T07:56:54.598 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455814 -le 1695457101 ]] 2023-09-23T07:56:54.598 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:56:54.598 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:56:54.598 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:56:55.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:55.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:55.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:55.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:55.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:55.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:55.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:55.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:55.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:55.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:55.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:55.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:56.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:56.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:56.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:56.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:56.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:56.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:56.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:56.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:56.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:56.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:56.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:56.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:56.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:56.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:56.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:56.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:58.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:58.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:56:58.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:58.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:56:58.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:58.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:58.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:58.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:58.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:58.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:58.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:58.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:58.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:58.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:58.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:58.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:58.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:58.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:58.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:58.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:56:59.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:59.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:56:59.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:59.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:56:59.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:59.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:56:59.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:59.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:56:59.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:59.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:56:59.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:59.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:56:59.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:59.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:56:59.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:59.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:56:59.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:56:59.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:00.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:00.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:00.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:00.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:00.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:00.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:00.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:00.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:00.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:00.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:00.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:00.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:00.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:00.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:00.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:00.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:01.965 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:01.961+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:57:01.966 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:01.965+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:57:01.966 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:01.965+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:57:02.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:57:02.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:02.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:02.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:02.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:02.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:02.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:02.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:02.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:02.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:02.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:02.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:04.600 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:57:04.600 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:57:04.615 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:57:04.631 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:57:04.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:04.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:04.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:04.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:04.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:04.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:04.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:04.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:04.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:04.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:04.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:04.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:05.934 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:57:05.934 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:57:05.935 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455825 2023-09-23T07:57:05.935 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455825 -le 1695457101 ]] 2023-09-23T07:57:05.935 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:57:05.935 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:57:05.935 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:57:06.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:06.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:06.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:06.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:07.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:07.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:07.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:07.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:07.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:07.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:07.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:07.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:07.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:07.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:07.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:07.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:07.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:07.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:08.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:08.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:08.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:08.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:08.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:08.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:08.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:08.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:08.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:08.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:08.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:08.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:08.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:08.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:09.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:09.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:09.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:09.082 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:57:09.081+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T07:57:09.082 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:57:09.081+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:57:09.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:09.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:09.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:09.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:09.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:09.130 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:09.125+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:57:09.130 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:09.125+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:57:09.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:10.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:10.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:10.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:10.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:10.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:10.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:09.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:10.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:10.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:10.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:10.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:10.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:10.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:10.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:10.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:10.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:10.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:11.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:11.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:11.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:11.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:11.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:11.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:11.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:11.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:11.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:11.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:11.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:11.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:11.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:11.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:11.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:11.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:12.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:12.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:12.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:12.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:12.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:12.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:12.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:12.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:12.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:12.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:12.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:12.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:12.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:12.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:12.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:12.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:12.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:12.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:13.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:13.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:13.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:13.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:13.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:13.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:14.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:14.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:14.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:14.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:14.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:14.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:14.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:14.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:14.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:14.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:14.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:14.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:14.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:14.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:15.507 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:15.505+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:57:15.507 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:15.505+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:57:15.507 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:15.505+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:57:15.937 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:57:15.937 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:57:15.939 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:57:15.946 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:57:17.478 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:57:17.479 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:57:17.479 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455837 2023-09-23T07:57:17.479 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455837 -le 1695457101 ]] 2023-09-23T07:57:17.479 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:57:17.480 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:57:17.480 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:57:17.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:17.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:17.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:17.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:17.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:17.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:17.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:17.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:17.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:17.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:17.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:17.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:18.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:18.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:18.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:18.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:18.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:18.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:18.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:18.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:18.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:18.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:19.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:19.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:19.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:19.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:19.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:19.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:19.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:19.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:19.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:19.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:19.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:19.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:19.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:19.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:19.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:19.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:19.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:19.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:19.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:19.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:20.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:20.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:20.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:20.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:20.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:20.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:20.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:20.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:20.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:20.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:20.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:20.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:20.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:20.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:20.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:20.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:20.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:20.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:20.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:20.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:20.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:21.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:21.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:21.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:21.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:22.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:22.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:22.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:22.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:22.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:22.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:22.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:22.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:22.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:22.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:22.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:22.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:22.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:22.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:22.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:22.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:22.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:22.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:22.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:22.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:23.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:23.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:23.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:23.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:23.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:23.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:23.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:23.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:23.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:23.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:23.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:23.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:23.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:23.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:23.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:23.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:23.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:23.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:23.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:23.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:23.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:23.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:23.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:23.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:23.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:23.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:23.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:24.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:24.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:24.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:24.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:24.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:24.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:24.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:24.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:24.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:24.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:24.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:24.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:24.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:24.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:24.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:24.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:24.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:57:24.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:24.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:24.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:24.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:24.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:24.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:24.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:24.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:25.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:25.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:24.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:25.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:25.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:25.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:25.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:25.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:25.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:25.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:25.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:25.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:25.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:25.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:25.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:25.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:25.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:25.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:25.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:25.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:25.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:25.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:25.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:25.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:25.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:25.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:25.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:25.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:25.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:25.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:25.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:25.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:25.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:25.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:25.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:25.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:25.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:25.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:27.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:27.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:27.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:27.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:27.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:27.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:27.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:27.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:27.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:27.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:27.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:27.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:27.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:27.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:27.482 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:57:27.484 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:57:27.485 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:57:27.501 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:57:28.911 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:57:28.911 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:57:28.913 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455848 2023-09-23T07:57:28.913 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455848 -le 1695457101 ]] 2023-09-23T07:57:28.913 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:57:28.913 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:57:28.913 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:57:29.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:29.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:29.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:29.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:29.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:29.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:29.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:29.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:29.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:29.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:29.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:29.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:30.600 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:30.596+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:57:31.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:31.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:31.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:31.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:31.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:31.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:31.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:31.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:31.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:31.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:31.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:31.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:31.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:31.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:31.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:31.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:32.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:32.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:32.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:32.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:32.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:32.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:32.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:32.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:32.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:32.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:32.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:32.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:32.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:32.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:32.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:32.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:32.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:32.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:32.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:32.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:33.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:33.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:33.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:33.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:33.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:33.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:33.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:33.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:33.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:33.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:57:33.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:33.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:33.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:33.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:33.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:33.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:33.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:33.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:33.712 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:33.708+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:57:35.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:35.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:35.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:35.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:35.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:35.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:35.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:35.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:35.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:35.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:35.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:35.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:35.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:37.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:37.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:37.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:37.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:37.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:37.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:37.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:37.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:37.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:37.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:37.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:37.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:37.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:37.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:38.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:57:38.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:38.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:38.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:38.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:38.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:38.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:38.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:38.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:38.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:38.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:38.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:38.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:38.926 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:57:38.926 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:57:38.927 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:57:38.942 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:57:40.218 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:57:40.231 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:57:40.232 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455860 2023-09-23T07:57:40.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455860 -le 1695457101 ]] 2023-09-23T07:57:40.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:57:40.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:57:40.233 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:57:40.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:40.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:40.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:40.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:40.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:40.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:40.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:40.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:40.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:40.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:40.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:40.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:40.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:40.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:40.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:40.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:40.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:40.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:40.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:40.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:40.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:41.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:41.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:41.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:41.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:41.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:41.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:41.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:41.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:41.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:41.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:41.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:41.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:41.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:41.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:41.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:41.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:41.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:41.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:41.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:41.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:42.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:42.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:42.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:42.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:42.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:42.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:42.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:42.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:42.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:42.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:43.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:43.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:43.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:43.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:43.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:43.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:43.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:43.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:43.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:43.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:43.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:43.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:43.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:44.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:44.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:44.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:44.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:44.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:44.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:44.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:44.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:44.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:44.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:44.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:44.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:44.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:44.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:44.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:44.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:44.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:44.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:44.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:44.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:57:44.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:44.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:44.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:44.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:44.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:44.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:44.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:44.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:44.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:44.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:44.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:44.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:44.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:44.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:44.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:44.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:44.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:45.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:45.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:45.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:45.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:45.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:45.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:45.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:45.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:45.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:45.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:45.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:45.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:45.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:45.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:45.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:45.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:45.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:45.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:45.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:45.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:46.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:46.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:46.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:46.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:46.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:46.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:46.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:46.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:46.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:46.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:46.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:46.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:46.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:46.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:46.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:46.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:46.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:46.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:46.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:46.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:46.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:46.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:46.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:46.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:46.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:46.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:57:46.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:46.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:46.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:46.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:46.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:46.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:46.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:46.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:46.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:46.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:46.965 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:46.960+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:57:46.965 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:46.960+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:57:47.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:47.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:47.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:47.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:47.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:47.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:47.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:47.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:47.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:47.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:47.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:47.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:47.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:47.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:48.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:48.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:48.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:48.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:48.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:48.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:48.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:48.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:48.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:48.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:48.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:48.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:48.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:48.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:48.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:48.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:48.703 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:48.700+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:57:48.704 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:57:48.700+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:57:49.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:49.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:49.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:49.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:49.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:49.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:49.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:49.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:49.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:49.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:49.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:49.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:49.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:49.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:49.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:49.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:50.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:50.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:50.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:50.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:50.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:50.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:50.234 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:57:50.238 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:57:50.238 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:57:50.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:50.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:50.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:50.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:50.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:50.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:50.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:50.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:50.281 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:57:50.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:50.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:50.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:50.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:50.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:50.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:50.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:50.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:51.525 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:57:51.540 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:57:51.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455871 2023-09-23T07:57:51.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455871 -le 1695457101 ]] 2023-09-23T07:57:51.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:57:51.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:57:51.541 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:57:52.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:52.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:52.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:52.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:52.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:52.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:52.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:52.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:52.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:52.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:52.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:52.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:52.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:52.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:52.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:52.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:52.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:52.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:52.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:53.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:53.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:53.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:53.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:53.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:53.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:53.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:53.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:53.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:53.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:53.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:53.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:53.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:53.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:53.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:53.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:55.006 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:57:55.004+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:57:56.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:56.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:56.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:56.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:57.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:57.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:57.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:57.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:57.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:57.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:57.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:57.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:57.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:57.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:57:57.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:57.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:57.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:57.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:57.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:57.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:57.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:57.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:57.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:57.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:57.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:57.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:57:57.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:57.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:57.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:57.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:57.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:57.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:57.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:57.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:57.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:57.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:57.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:57.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:58.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:57:58.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:57:58.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:57:58.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:57:58.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:58.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:58.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:57:58.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:58.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:58.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:58.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:58.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:57:59.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:59.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:57:59.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:59.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:57:59.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:59.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:57:59.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:59.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:57:59.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:59.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:57:59.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:57:59.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:01.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:01.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:01.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:01.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:01.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:01.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:01.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:01.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:01.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:01.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:01.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:01.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:01.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:01.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:01.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:01.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:01.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:01.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:01.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:01.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:01.554 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:58:01.559 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:58:01.561 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:58:01.606 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:58:03.056 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:58:03.062 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:58:03.063 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455883 2023-09-23T07:58:03.063 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455883 -le 1695457101 ]] 2023-09-23T07:58:03.063 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:58:03.063 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:58:03.063 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:58:03.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:03.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:03.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:03.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:03.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:03.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:03.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:03.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:03.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:03.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:03.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:03.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:03.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:03.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:03.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:03.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:04.547 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:04.544+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:58:06.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:06.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:06.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:06.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:06.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:06.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:06.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:06.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:06.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:06.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:06.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:06.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:06.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:06.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:06.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:06.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:06.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:07.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:07.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:07.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:07.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:07.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:07.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:07.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:07.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:07.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:07.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:07.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:07.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:07.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:07.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:07.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:07.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:07.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:07.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:07.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:07.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:08.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:08.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:08.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:08.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:08.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:08.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:08.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:08.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:08.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:08.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:08.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:08.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:08.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:08.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:08.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:08.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:08.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:08.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:08.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:08.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:08.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:09.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:09.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:09.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:09.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:09.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:09.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:09.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:09.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:09.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:09.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:09.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:09.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:09.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:09.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:09.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:10.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:10.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:10.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:10.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:10.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:10.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:10.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:10.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:10.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:10.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:10.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:10.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:10.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:10.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:10.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:58:10.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:10.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:10.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:10.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:10.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:10.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:11.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:11.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:11.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:11.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:11.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:11.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:11.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:11.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:11.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:11.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:11.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:11.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:11.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:11.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:11.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:11.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:11.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:11.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:11.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:11.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:12.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:12.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:12.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:12.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:12.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:12.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:12.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:12.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:12.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:12.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:12.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:12.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:12.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:12.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:12.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:12.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:12.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:12.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:12.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:12.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:12.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:12.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:12.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:12.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:12.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:12.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:13.066 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:58:13.070 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:58:13.070 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:58:13.075 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:58:14.666 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:58:14.690 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:58:14.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455894 2023-09-23T07:58:14.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455894 -le 1695457101 ]] 2023-09-23T07:58:14.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:58:14.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:58:14.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:58:15.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:15.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:15.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:15.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:15.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:15.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:15.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:15.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:15.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:15.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:16.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:16.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:16.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:16.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:16.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:16.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:16.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:16.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:16.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:16.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:16.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:16.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:16.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:16.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:17.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:17.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:17.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:17.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:17.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:17.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:17.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:17.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:17.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:17.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:17.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:17.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:17.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:17.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:17.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:17.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:17.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:17.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:18.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:58:18.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:18.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:18.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:18.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:18.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:18.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:18.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:18.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:18.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:18.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:18.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:18.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:19.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:19.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:19.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:19.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:19.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:19.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:19.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:19.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:19.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:19.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:19.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:19.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:20.724 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:20.719+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:58:20.724 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:20.719+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:58:23.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:23.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:58:23.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:23.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:23.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:23.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:23.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:23.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:23.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:23.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:23.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:23.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:23.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:23.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:23.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:23.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:23.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:23.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:23.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:23.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:24.697 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:58:24.699 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:58:24.699 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:58:24.700 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:58:25.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:25.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:25.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:25.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:25.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:25.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:25.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:25.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:25.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:25.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:25.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:58:25.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:25.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:25.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:25.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:25.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:25.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:25.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:25.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:25.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:25.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:25.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:25.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:25.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:26.234 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:58:26.256 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:58:26.258 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455906 2023-09-23T07:58:26.258 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455906 -le 1695457101 ]] 2023-09-23T07:58:26.258 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:58:26.258 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:58:26.258 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:58:26.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:26.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:26.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:26.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:26.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:26.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:26.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:26.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:26.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:26.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:26.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:26.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:28.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:28.346 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T07:58:28.339+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T07:58:28.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:58:28.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:28.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:28.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:28.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:28.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:28.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:28.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:28.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:28.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:28.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:28.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:28.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:29.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:29.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:29.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:29.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:29.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:29.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:29.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:29.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:29.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:29.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:30.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:29.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:30.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:30.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:30.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:30.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:30.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:30.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:30.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:30.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:31.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:31.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:31.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:31.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:31.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:31.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:31.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:31.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:31.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:31.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:31.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:31.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:31.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:31.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:31.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:31.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:35.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:35.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:35.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:35.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:35.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:35.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:35.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:35.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:35.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:35.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:35.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:58:35.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:35.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:35.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:35.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:35.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:35.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:35.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:35.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:35.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:35.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:35.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:35.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:36.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:36.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:36.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:36.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:36.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:36.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:36.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:36.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:36.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:36.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:36.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:36.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:36.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:36.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:36.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:36.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:36.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:36.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:36.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:36.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:36.274 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:58:36.274 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:58:36.277 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:58:36.295 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:58:37.978 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:58:37.978 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:58:37.980 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455917 2023-09-23T07:58:37.980 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455917 -le 1695457101 ]] 2023-09-23T07:58:37.980 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:58:37.980 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:58:37.980 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:58:38.591 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:38.587+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:58:38.595 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:38.591+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:58:38.595 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:38.591+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:58:38.595 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:38.591+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:58:40.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:40.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:58:40.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:40.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:40.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:40.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:40.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:40.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:40.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:40.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:40.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:40.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:40.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:40.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:40.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:40.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:40.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:40.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:41.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:58:41.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:41.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:41.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:41.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:41.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:41.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:41.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:41.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:41.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:41.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:41.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:41.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:43.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:43.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:58:43.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:43.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:43.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:43.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:43.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:43.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:43.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:43.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:43.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:43.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:43.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:43.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:43.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:43.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:43.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:43.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:43.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:43.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:45.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:45.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:45.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:45.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:45.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:45.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:45.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:45.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:45.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:45.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:45.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:45.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:45.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:45.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:45.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:45.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:45.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:46.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:46.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:46.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:46.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:46.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:46.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:46.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:46.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:46.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:46.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:46.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:46.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:46.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:46.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:46.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:46.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:46.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:46.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:46.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:46.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:47.986 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:58:47.986 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:58:47.990 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:58:47.993 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:58:49.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:49.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:49.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:49.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:49.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:49.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:49.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:49.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:49.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:49.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:49.484 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:58:49.496 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:58:49.503 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455929 2023-09-23T07:58:49.503 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455929 -le 1695457101 ]] 2023-09-23T07:58:49.503 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:58:49.503 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:58:49.503 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:58:49.722 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:49.715+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:58:49.965 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:49.959+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:58:49.966 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:49.959+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:58:51.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:51.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:51.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:51.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:51.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:51.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:51.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:51.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:51.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:51.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:51.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:51.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:51.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:51.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:51.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:51.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:51.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:51.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:51.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:51.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:54.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:54.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:54.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:54.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:54.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:54.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:54.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:54.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:54.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:54.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:54.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:54.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:54.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:54.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:54.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:54.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:54.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:54.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:54.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:54.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:56.139 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:58:56.135+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:58:56.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:56.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:56.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:56.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:58:56.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:56.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:58:56.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:56.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:56.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:56.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:58:56.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:56.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:58:56.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:56.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:56.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:56.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:56.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:56.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:58.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:58.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:58:58.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:58.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:58:58.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:58.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:58:58.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:58.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:58:58.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:58.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:58:58.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:58.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:58:58.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:58:58.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:58:59.521 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:58:59.525 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:58:59.539 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:58:59.546 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:59:00.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:59:00.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:00.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:00.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:00.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:00.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:00.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:00.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:00.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:00.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:00.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:00.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:00.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:00.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:00.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:00.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:00.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:00.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:00.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:00.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:00.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:00.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:00.761 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:59:00.766 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:59:00.774 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455940 2023-09-23T07:59:00.774 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455940 -le 1695457101 ]] 2023-09-23T07:59:00.774 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:59:00.774 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:59:00.774 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:59:01.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:01.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:01.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:01.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:01.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:01.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:01.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:01.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:01.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:01.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:01.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:01.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:01.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:01.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:01.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:01.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:01.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:01.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:01.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:01.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:01.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:01.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:01.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:01.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:01.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:01.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:01.878 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:01.867+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:01.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:01.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:01.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:01.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:01.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:02.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:02.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:02.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:02.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:02.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:02.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:02.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:02.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:02.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:02.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:02.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:02.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:02.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:02.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:02.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:02.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:02.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:02.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:02.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:02.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:04.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:04.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:04.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:04.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:04.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:04.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:04.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:04.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:04.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:04.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:04.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:04.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:04.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:04.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:04.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:04.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:04.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:04.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:04.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:04.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:07.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:07.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:07.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:07.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:07.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:07.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:07.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:07.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:07.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:07.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:07.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:07.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:07.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:07.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:08.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:08.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:08.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:08.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:08.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:08.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:08.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:08.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:08.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:08.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:59:08.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:08.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:08.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:08.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:08.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:08.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:08.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:08.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:08.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:09.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:09.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:09.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:09.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:09.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:09.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:09.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:09.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:09.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:09.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:09.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:09.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:09.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:09.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:09.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:09.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:09.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:09.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:09.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:09.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:09.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:09.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:09.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:10.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:10.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:10.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:10.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:10.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:10.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:10.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:10.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:10.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:10.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:10.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:10.662 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:10.658+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:10.662 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:10.658+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:10.776 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:59:10.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:10.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:10.794 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:59:10.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:10.802 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:59:10.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:10.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:10.815 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:59:10.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:10.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:10.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:10.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:10.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:10.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:10.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:11.204 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:11.198+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:59:11.204 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:11.198+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:11.204 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:11.198+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:12.413 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:59:12.441 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:59:12.446 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455952 2023-09-23T07:59:12.446 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455952 -le 1695457101 ]] 2023-09-23T07:59:12.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:59:12.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:59:12.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:59:12.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:12.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:12.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:12.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:12.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:12.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:12.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:12.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:12.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:12.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:12.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:12.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:12.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:13.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:13.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:13.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:13.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:13.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:13.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:13.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:13.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:13.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:13.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:13.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:13.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:13.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:13.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:13.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:13.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:13.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:13.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:13.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:13.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:13.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:13.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:13.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:13.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:13.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:14.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:14.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:14.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:14.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:14.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:14.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:14.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:14.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:14.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:14.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:14.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:14.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:14.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:14.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:14.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:14.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:14.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:14.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:14.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:14.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:14.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:14.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:14.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:14.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:14.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:15.978 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:15.970+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:15.978 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:15.970+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:16.237 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:16.230+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:16.237 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:16.230+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:18.110 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:18.098+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:59:18.110 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:18.098+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T07:59:18.110 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:18.098+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:59:18.130 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:18.122+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:59:18.130 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:18.122+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:18.136 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:18.126+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:18.559 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:18.554+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:20.405 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:20.398+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:20.405 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:20.398+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:20.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:20.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:20.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:20.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:20.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:20.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:20.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:20.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:20.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:20.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:20.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:20.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:21.647 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:21.642+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:21.647 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:21.642+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:22.053 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:22.042+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:59:22.053 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:22.042+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:59:22.064 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:22.058+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:59:22.064 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:22.058+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:22.065 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:22.058+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:22.466 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:59:22.467 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:59:22.467 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:59:22.467 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:59:22.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:22.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:22.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:22.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:22.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:22.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:22.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:22.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:22.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:22.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:22.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:22.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:22.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:22.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:22.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:22.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:22.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:22.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:22.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:22.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:23.740 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:59:23.746 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:59:23.747 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455963 2023-09-23T07:59:23.747 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455963 -le 1695457101 ]] 2023-09-23T07:59:23.747 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:59:23.747 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:59:23.748 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:59:25.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:25.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:26.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:26.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:26.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:26.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:26.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:26.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:26.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:26.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:26.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:26.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:26.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:26.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:26.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:26.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:26.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:26.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:26.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:26.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:27.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:27.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:27.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:27.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:27.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:27.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:27.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:27.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:27.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:27.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:27.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:27.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:27.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:27.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:27.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:27.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:27.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:27.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:28.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:28.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:28.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:28.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:28.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:28.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:28.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:28.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:28.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:28.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:28.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:28.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:28.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:28.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:28.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:28.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:28.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:28.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:28.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:28.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:28.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:28.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:28.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:28.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:28.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:28.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:28.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:28.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:28.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:30.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:59:30.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:30.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:30.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:30.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:30.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:31.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:31.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:31.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:31.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:31.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:31.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:31.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:31.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:31.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:31.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:31.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:31.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:31.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:31.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:31.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:31.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:31.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:31.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:31.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:31.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:32.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:32.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:32.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:32.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:32.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:32.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:32.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:32.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:32.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:32.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:32.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:32.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:32.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:32.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:32.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:32.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:32.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:32.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:32.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:32.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:32.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:32.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:33.757 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:59:33.762 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:59:33.778 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:59:33.818 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:59:34.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:33.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:34.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:34.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:34.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:34.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:34.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:34.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:34.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:34.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:34.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:34.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:34.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:34.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:34.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:34.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:34.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:34.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:34.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:34.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:34.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:34.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:34.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:34.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:34.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:34.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:34.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:34.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:34.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:34.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:34.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:34.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:34.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:34.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:34.787 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:34.782+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:59:34.787 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:34.782+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:34.787 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:34.782+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:35.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:35.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:35.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:35.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:35.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:35.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:35.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:35.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:35.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:35.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:35.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:35.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:35.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:35.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:35.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:35.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:35.147 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:59:35.151 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:59:35.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:35.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:35.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455975 2023-09-23T07:59:35.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455975 -le 1695457101 ]] 2023-09-23T07:59:35.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:59:35.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:59:35.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:59:35.215 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:35.210+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T07:59:35.221 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:35.214+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T07:59:36.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:36.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:36.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:36.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:36.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:36.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:36.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:36.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:36.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:36.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:36.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:36.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:36.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:36.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:36.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:36.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:36.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:36.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:36.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:36.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:36.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:36.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:37.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:37.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:37.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:37.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:37.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:37.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:37.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:37.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:37.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:37.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:37.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:37.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:37.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:37.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:37.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:37.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:37.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:37.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:38.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:38.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:38.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:38.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:38.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:38.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:38.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:38.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:38.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:38.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:38.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:38.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:38.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:38.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:38.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:38.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:38.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:38.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:39.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:39.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:39.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:39.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:39.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:39.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:39.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:39.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:39.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:39.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:39.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:39.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:40.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:40.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:40.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:40.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:40.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:40.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:40.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:40.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:40.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:40.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:40.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:40.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:41.165 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:41.158+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T07:59:41.165 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:41.158+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:41.171 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:41.162+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:41.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:41.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:41.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:41.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:41.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:41.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:41.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:41.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:41.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:41.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:41.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:41.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:44.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:44.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:44.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:44.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:44.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:44.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:44.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:44.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:44.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:44.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:44.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:44.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:44.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:44.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:44.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:44.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:44.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:44.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:44.606 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:44.602+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T07:59:44.606 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:44.602+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:45.192 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:59:45.192 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:59:45.202 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:59:45.202 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:59:45.713 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T07:59:45.706+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T07:59:46.526 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:59:46.531 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:59:46.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455986 2023-09-23T07:59:46.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455986 -le 1695457101 ]] 2023-09-23T07:59:46.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:59:46.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:59:46.533 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:59:48.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:48.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:48.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:48.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:48.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:48.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:49.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:49.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:49.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:49.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:49.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:49.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:49.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:49.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:49.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:49.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:49.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:49.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:49.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:49.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:49.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:49.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:49.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:49.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:49.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:49.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:50.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:50.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:50.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:50.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:50.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:50.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:50.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:50.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:50.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:50.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:50.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:50.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:50.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:50.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:50.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:50.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:50.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:50.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:50.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:50.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:50.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:50.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:52.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:52.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:52.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:52.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:52.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:52.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:52.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:52.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:52.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:52.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:52.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:52.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:54.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:54.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:54.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:54.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:54.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:54.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:54.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:54.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:54.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:54.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:54.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:54.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:54.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:54.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:54.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:54.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:54.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:54.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:55.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:55.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:55.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:55.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:55.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:55.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:55.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:55.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:55.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:55.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:55.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:55.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:56.536 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T07:59:56.536 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T07:59:56.540 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T07:59:56.541 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T07:59:57.846 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T07:59:57.849 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T07:59:57.850 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695455997 2023-09-23T07:59:57.851 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695455997 -le 1695457101 ]] 2023-09-23T07:59:57.851 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T07:59:57.851 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T07:59:57.851 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T07:59:58.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:58.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:58.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:58.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:58.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:58.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:58.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:58.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:58.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:58.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:59:58.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:58.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:58.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:58.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:58.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:58.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:58.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:58.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:58.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:58.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:58.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:58.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:58.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:58.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:58.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:58.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:58.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:58.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:58.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:58.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T07:59:58.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T07:59:58.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T07:59:58.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T07:59:58.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T07:59:58.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T07:59:58.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T07:59:58.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T07:59:58.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T07:59:58.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T07:59:58.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T07:59:58.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T07:59:58.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T07:59:58.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:01.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:01.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:01.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:01.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:01.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:01.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:01.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:01.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:01.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:01.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:01.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:01.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:01.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:01.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:01.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:01.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:02.252 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:00:02.250+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:00:02.252 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:00:02.250+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:00:02.351 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:02.350+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:00:02.351 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:02.350+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:00:02.351 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:02.350+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:00:02.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:02.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:02.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:02.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:02.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:02.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:02.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:02.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:02.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:02.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:02.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:02.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:03.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:03.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:03.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:03.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:03.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:03.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:03.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:03.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:03.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:03.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:03.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:03.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:04.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:04.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:04.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:04.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:04.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:04.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:04.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:04.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:04.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:04.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:04.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:04.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:04.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:04.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:04.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:04.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:04.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:04.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:04.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:04.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:05.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:05.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:05.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:05.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:05.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:05.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:05.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:05.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:05.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:05.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:05.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:05.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:05.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:05.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:05.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:05.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:05.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:05.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:06.394 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:06.385+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:00:07.853 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:00:07.858 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:00:07.860 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:00:07.867 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:00:08.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:08.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:08.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:08.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:08.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:08.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:08.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:08.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:08.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:08.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:08.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:08.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:09.171 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:00:09.171 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:00:09.185 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456009 2023-09-23T08:00:09.185 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456009 -le 1695457101 ]] 2023-09-23T08:00:09.185 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:00:09.185 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:00:09.185 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:00:10.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:10.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:10.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:10.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:10.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:10.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:10.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:10.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:10.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:10.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:10.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:10.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:10.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:10.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:10.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:10.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:10.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:10.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:10.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:10.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:11.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:11.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:11.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:11.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:11.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:11.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:11.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:11.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:11.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:11.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:11.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:11.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:00:11.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:11.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:11.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:11.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:11.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:11.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:11.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:11.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:11.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:11.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:11.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:11.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:13.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:00:13.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:13.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:13.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:13.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:13.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:13.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:13.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:13.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:13.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:13.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:13.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:13.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:13.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:13.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:13.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:13.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:13.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:13.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:13.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:13.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:13.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:13.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:14.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:14.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:14.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:14.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:14.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:14.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:14.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:14.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:14.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:14.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:14.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:14.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:14.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:14.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:14.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:14.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:15.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:15.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:15.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:15.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:15.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:15.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:15.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:15.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:15.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:15.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:00:15.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:15.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:15.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:15.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:15.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:15.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:15.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:15.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:15.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:15.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:15.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:15.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:16.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:16.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:16.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:16.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:16.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:16.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:16.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:16.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:16.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:16.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:16.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:16.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:17.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:17.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:17.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:17.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:17.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:17.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:17.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:17.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:17.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:17.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:17.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:17.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:17.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:17.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:17.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:17.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:17.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:17.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:17.993 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:17.989+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:00:17.994 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:17.989+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:00:18.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:18.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:18.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:18.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:18.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:18.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:18.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:18.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:18.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:18.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:18.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:18.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:18.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:18.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:18.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:18.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:18.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:18.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:18.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:18.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:18.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:18.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:18.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:18.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:18.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:18.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:18.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:18.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:18.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:18.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:18.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:18.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:18.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:19.190 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:00:19.190 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:00:19.190 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:00:19.191 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:00:19.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:19.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:19.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:19.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:19.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:19.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:19.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:19.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:19.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:19.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:19.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:19.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:19.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:19.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:19.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:19.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:19.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:19.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:19.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:19.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:20.648 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:00:20.648 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:00:20.649 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456020 2023-09-23T08:00:20.649 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456020 -le 1695457101 ]] 2023-09-23T08:00:20.649 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:00:20.649 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:00:20.649 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:00:20.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:20.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:20.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:20.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:20.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:20.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:20.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:20.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:20.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:20.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:20.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:20.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:21.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:21.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:21.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:21.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:21.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:21.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:21.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:21.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:21.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:21.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:21.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:21.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:22.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:22.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:22.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:22.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:22.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:22.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:22.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:22.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:22.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:22.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:22.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:22.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:22.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:22.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:22.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:22.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:25.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:25.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:25.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:25.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:25.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:25.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:25.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:25.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:26.777 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:26.773+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:00:26.778 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:26.773+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:00:27.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:27.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:27.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:27.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:27.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:27.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:27.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:27.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:27.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:27.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:27.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:27.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:28.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:27.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:28.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:27.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:28.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:28.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:28.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:28.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:29.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:29.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:29.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:29.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:29.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:29.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:29.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:29.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:29.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:29.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:29.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:29.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:29.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:29.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:29.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:29.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:29.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:29.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:29.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:29.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:30.563 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:30.561+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:00:30.563 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:30.561+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:00:30.563 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:30.561+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:00:30.654 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:00:30.655 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:00:30.660 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:00:30.682 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:00:32.038 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:00:32.039 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:00:32.039 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456032 2023-09-23T08:00:32.039 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456032 -le 1695457101 ]] 2023-09-23T08:00:32.040 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:00:32.040 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:00:32.040 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:00:32.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:32.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:32.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:32.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:32.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:32.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:32.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:32.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:32.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:32.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:32.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:32.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:34.525 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:34.521+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:00:34.530 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:34.525+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:00:34.546 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:34.545+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:00:34.546 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:34.545+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:00:34.546 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:34.545+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:00:35.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:35.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:35.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:35.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:35.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:35.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:35.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:35.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:35.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:35.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:00:35.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:35.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:35.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:35.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:35.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:35.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:35.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:35.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:35.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:35.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:35.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:35.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:35.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:35.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:35.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:35.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:35.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:35.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:36.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:36.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:37.503 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:37.501+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:00:38.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:38.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:38.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:38.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:38.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:38.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:38.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:38.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:38.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:38.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:38.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:38.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:38.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:38.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:38.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:38.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:38.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:38.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:41.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:41.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:41.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:41.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:41.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:41.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:41.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:41.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:41.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:41.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:41.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:41.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:41.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:41.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:41.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:41.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:41.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:41.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:41.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:41.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:41.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:41.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:41.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:42.048 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:00:42.052 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:00:42.065 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:00:42.080 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:00:42.949 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:42.945+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:00:42.950 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:42.945+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:00:42.950 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:42.945+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:00:43.531 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:00:43.534 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:00:43.536 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456043 2023-09-23T08:00:43.536 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456043 -le 1695457101 ]] 2023-09-23T08:00:43.536 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:00:43.536 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:00:43.536 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:00:43.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:43.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:43.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:43.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:43.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:43.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:43.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:43.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:43.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:43.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:43.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:43.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:43.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:43.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:43.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:43.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:43.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:43.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:45.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:45.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:45.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:45.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:45.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:45.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:45.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:45.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:45.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:45.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:45.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:45.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:45.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:45.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:45.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:45.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:46.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:46.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:46.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:46.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:46.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:46.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:46.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:46.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:46.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:46.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:46.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:46.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:46.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:46.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:46.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:46.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:46.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:46.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:46.611 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:46.609+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:00:46.623 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:46.621+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:00:46.623 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:46.621+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:00:46.640 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:46.637+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:00:46.640 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:46.637+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:00:48.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:48.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:48.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:48.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:48.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:48.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:48.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:48.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:48.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:48.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:48.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:48.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:48.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:48.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:48.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:48.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:50.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:50.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:50.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:50.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:50.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:50.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:50.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:50.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:50.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:00:50.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:50.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:50.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:50.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:50.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:50.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:50.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:52.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:52.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:52.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:52.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:52.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:52.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:52.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:52.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:52.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:52.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:52.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:52.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:52.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:52.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:52.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:52.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:52.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:52.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:53.551 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:00:53.564 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:00:53.566 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:00:53.567 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:00:55.129 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:00:55.149 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:00:55.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456055 2023-09-23T08:00:55.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456055 -le 1695457101 ]] 2023-09-23T08:00:55.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:00:55.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:00:55.152 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:00:55.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:55.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:55.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:55.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:55.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:55.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:55.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:55.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:55.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:55.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:55.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:55.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:55.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:55.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:55.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:55.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:55.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:55.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:55.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:55.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:56.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:56.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:56.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:00:56.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:56.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:56.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:56.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:56.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:56.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:56.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:56.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:56.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:57.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:57.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:00:57.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:57.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:57.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:57.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:57.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:57.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:57.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:57.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:57.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:57.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:57.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:57.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:57.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:57.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:58.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:58.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:00:58.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:58.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:58.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:58.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:58.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:58.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:00:58.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:58.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:00:58.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:58.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:58.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:58.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:58.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:58.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:58.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:58.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:00:59.688 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:59.685+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:00:59.688 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:59.685+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:00:59.688 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:00:59.685+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:00:59.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:59.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:00:59.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:59.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:00:59.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:59.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:00:59.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:59.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:00:59.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:59.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:00:59.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:00:59.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:00.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:00.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:00.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:00.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:00.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:00.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:00.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:00.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:00.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:00.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:00.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:00.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:00.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:00.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:00.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:00.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:00.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:00.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:00.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:00.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:00.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:00.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:01.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:01.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:01.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:01.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:01.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:01.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:01.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:01.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:01.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:01.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:01.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:01.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:01.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:01.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:01.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:01.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:01.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:01.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:01.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:01.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:01.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:01.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:01.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:01.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:01.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:02.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:02.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:02.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:02.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:05.155 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:01:05.158 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:01:05.159 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:01:05.171 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:01:05.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:05.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:05.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:05.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:05.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:05.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:05.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:05.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:05.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:05.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:05.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:05.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:05.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:05.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:05.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:05.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:05.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:05.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:05.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:05.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:05.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:07.036 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:01:07.037 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:01:07.038 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456067 2023-09-23T08:01:07.038 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456067 -le 1695457101 ]] 2023-09-23T08:01:07.038 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:01:07.038 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:01:07.039 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:01:07.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:01:07.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:07.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:07.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:07.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:07.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:07.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:07.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:07.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:07.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:07.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:07.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:07.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:07.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:07.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:07.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:07.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:07.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:07.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:07.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:07.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:07.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:07.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:07.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:07.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:08.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:08.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:08.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:08.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:08.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:08.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:08.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:08.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:08.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:08.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:08.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:08.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:08.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:08.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:08.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:08.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:08.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:08.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:09.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:09.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:09.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:09.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:09.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:09.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:09.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:09.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:09.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:09.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:09.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:09.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:10.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:10.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:10.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:10.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:10.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:10.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:10.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:10.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:10.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:10.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:10.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:10.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:10.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:10.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:10.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:10.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:10.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:10.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:10.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:10.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:10.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:10.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:11.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:11.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:01:11.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:11.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:11.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:11.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:11.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:11.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:11.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:11.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:11.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:11.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:11.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:11.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:01:11.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:11.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:11.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:11.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:11.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:11.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:11.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:11.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:11.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:11.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:11.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:11.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:11.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:11.622 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:11.620+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:01:11.622 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:11.620+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:01:11.622 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:11.620+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:01:12.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:12.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:12.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:12.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:12.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:12.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:12.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:12.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:12.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:12.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:12.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:12.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:12.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:12.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:12.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:12.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:12.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:12.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:12.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:14.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:14.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:14.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:14.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:14.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:14.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:14.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:14.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:14.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:14.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:14.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:14.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:15.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:15.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:15.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:15.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:15.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:15.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:15.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:15.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:15.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:15.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:15.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:15.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:15.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:15.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:15.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:15.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:17.055 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:01:17.055 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:01:17.055 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:01:17.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:17.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:17.076 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:01:17.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:17.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:17.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:17.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:17.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:17.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:17.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:17.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:17.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:17.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:17.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:17.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:17.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:17.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:17.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:17.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:17.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:17.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:18.449 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:01:18.454 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:01:18.455 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456078 2023-09-23T08:01:18.455 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456078 -le 1695457101 ]] 2023-09-23T08:01:18.456 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:01:18.456 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:01:18.456 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:01:21.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:21.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:21.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:21.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:21.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:21.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:21.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:21.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:21.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:21.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:21.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:21.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:23.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:22.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:23.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:23.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:23.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:23.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:23.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:23.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:23.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:23.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:23.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:01:23.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:23.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:23.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:23.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:23.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:23.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:23.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:23.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:23.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:23.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:23.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:23.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:27.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:27.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:27.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:27.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:27.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:27.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:27.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:27.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:27.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:27.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:27.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:27.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:27.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:27.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:27.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:27.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:27.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:27.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:27.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:27.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:27.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:27.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:27.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:01:27.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:27.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:27.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:27.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:27.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:27.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:27.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:27.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:28.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:28.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:28.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:28.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:28.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:01:28.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:28.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:28.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:28.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:28.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:28.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:28.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:28.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:28.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:28.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:28.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:28.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:28.459 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:01:28.459 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:01:28.460 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:01:28.464 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:01:29.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:29.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:29.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:29.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:29.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:29.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:29.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:29.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:29.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:29.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:29.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:29.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:29.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:29.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:29.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:29.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:29.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:29.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:29.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:29.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:29.955 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:01:29.955 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:01:29.956 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456089 2023-09-23T08:01:29.956 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456089 -le 1695457101 ]] 2023-09-23T08:01:29.957 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:01:29.957 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:01:29.957 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:01:34.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:34.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:34.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:34.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:34.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:34.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:34.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:34.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:34.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:34.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:34.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:34.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:34.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:34.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:34.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:34.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:34.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:34.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:34.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:34.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:36.347 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:36.344+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:01:36.347 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:36.344+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:01:36.351 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:36.348+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:01:36.351 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:36.348+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:01:36.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:36.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:36.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:36.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:36.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:36.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:36.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:36.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:36.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:36.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:36.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:36.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:36.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:36.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:36.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:36.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:36.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:36.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:36.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:36.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:36.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:37.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:37.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:37.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:37.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:37.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:37.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:37.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:37.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:37.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:37.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:37.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:37.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:37.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:37.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:38.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:38.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:38.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:38.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:38.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:38.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:38.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:38.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:38.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:38.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:38.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:38.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:38.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:38.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:39.964 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:01:39.971 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:01:39.974 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:01:39.989 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:01:40.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:40.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:40.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:40.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:40.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:40.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:40.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:40.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:40.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:40.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:40.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:40.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:40.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:40.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:40.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:40.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:40.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:40.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:41.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:41.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:41.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:41.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:41.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:41.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:41.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:41.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:41.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:41.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:41.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:41.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:41.465 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:01:41.465 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:01:41.466 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456101 2023-09-23T08:01:41.466 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456101 -le 1695457101 ]] 2023-09-23T08:01:41.466 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:01:41.467 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:01:41.467 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:01:44.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:44.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:44.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:44.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:44.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:44.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:44.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:44.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:44.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:44.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:44.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:44.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:44.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:44.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:44.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:44.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:44.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:44.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:44.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:44.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:46.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:46.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:46.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:46.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:46.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:46.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:46.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:46.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:46.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:46.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:46.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:46.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:46.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:46.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:46.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:46.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:46.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:51.472 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:01:51.472 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:01:51.472 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:01:51.480 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:01:51.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:01:51.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:51.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:51.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:51.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:51.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:51.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:51.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:51.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:51.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:51.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:51.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:52.685 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:01:52.687 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:01:52.689 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456112 2023-09-23T08:01:52.689 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456112 -le 1695457101 ]] 2023-09-23T08:01:52.689 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:01:52.689 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:01:52.690 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:01:53.526 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:53.520+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:01:55.463 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:55.460+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:01:55.463 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:55.460+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:01:55.463 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:55.460+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:01:56.900 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:56.896+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:01:56.900 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:01:56.896+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:01:58.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:58.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:58.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:58.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:58.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:58.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:01:58.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:58.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:01:58.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:58.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:58.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:58.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:58.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:58.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:58.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:58.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:59.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:59.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:01:59.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:59.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:01:59.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:59.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:01:59.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:59.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:01:59.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:59.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:01:59.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:59.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:01:59.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:59.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:01:59.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:59.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:01:59.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:01:59.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:00.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:00.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:00.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:00.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:00.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:00.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:00.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:00.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:00.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:00.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:00.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:00.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:00.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:00.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:01.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:01.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:01.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:01.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:01.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:01.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:01.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:01.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:01.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:01.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:01.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:01.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:01.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:01.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:01.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:01.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:01.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:01.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:01.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:01.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:01.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:01.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:02:01.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:01.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:01.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:01.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:01.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:01.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:01.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:01.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:01.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:02.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:02.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:02.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:02.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:02.698 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:02:02.698 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:02:02.698 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:02:02.720 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:02:02.933 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:02.928+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:02:02.940 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:02.936+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:02:02.941 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:02.936+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:02:04.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:04.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:04.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:04.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:04.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:04.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:04.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:04.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:04.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:04.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:04.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:04.302 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:02:04.302 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:02:04.303 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456124 2023-09-23T08:02:04.303 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456124 -le 1695457101 ]] 2023-09-23T08:02:04.303 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:02:04.303 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:02:04.304 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:02:04.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:04.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:04.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:04.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:04.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:04.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:04.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:04.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:04.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:04.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:04.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:02:04.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:04.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:04.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:04.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:04.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:04.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:04.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:04.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:04.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:04.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:04.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:04.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:05.281 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:05.276+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:02:05.286 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:05.276+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:02:05.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:05.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:05.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:05.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:05.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:05.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:05.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:05.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:05.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:05.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:05.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:05.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:05.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:05.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:05.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:05.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:05.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:05.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:05.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:05.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:02:05.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:05.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:05.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:05.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:05.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:05.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:05.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:05.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:05.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:05.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:05.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:05.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:05.994 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:05.987+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:02:06.006 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:05.995+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:02:06.006 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:05.995+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:02:06.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:02:06.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:06.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:06.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:06.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:06.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:06.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:06.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:06.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:06.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:06.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:06.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:06.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:02:06.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:06.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:06.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:06.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:06.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:06.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:06.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:06.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:06.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:06.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:06.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:06.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:07.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:07.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:07.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:07.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:07.830 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:07.823+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:02:08.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:08.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:08.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:08.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:08.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:08.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:08.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:08.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:08.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:08.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:08.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:08.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:08.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:08.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:08.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:08.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:08.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:08.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:09.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:09.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:09.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:09.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:09.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:09.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:09.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:09.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:09.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:09.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:09.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:09.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:09.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:09.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:09.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:09.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:09.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:09.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:12.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:12.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:12.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:12.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:12.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:12.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:12.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:12.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:12.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:12.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:13.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:12.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:13.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:12.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:13.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:12.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:13.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:13.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:13.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:13.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:13.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:13.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:13.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:13.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:13.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:13.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:13.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:13.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:13.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:13.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:13.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:13.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:13.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:13.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:13.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:13.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:13.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:13.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:14.311 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:02:14.313 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:02:14.332 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:02:14.333 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:02:15.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:15.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:15.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:15.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:15.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:15.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:15.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:15.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:15.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:15.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:15.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:15.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:15.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:15.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:15.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:15.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:15.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:15.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:15.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:15.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:15.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:15.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:15.671 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:02:15.671 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:02:15.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456135 2023-09-23T08:02:15.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456135 -le 1695457101 ]] 2023-09-23T08:02:15.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:02:15.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:02:15.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:02:15.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:15.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:15.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:02:15.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:15.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:15.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:15.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:15.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:15.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:15.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:15.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:16.383 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:16.379+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:02:17.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:17.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:17.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:17.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:17.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:17.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:17.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:17.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:17.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:17.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:17.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:17.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:17.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:17.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:17.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:17.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:17.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:17.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:17.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:17.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:17.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:17.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:17.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:18.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:18.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:18.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:18.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:18.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:18.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:18.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:18.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:18.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:18.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:18.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:18.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:18.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:18.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:18.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:18.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:18.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:18.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:18.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:18.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:21.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:21.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:21.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:21.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:21.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:21.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:21.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:21.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:21.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:21.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:21.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:22.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:21.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:22.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:22.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:22.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:22.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:22.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:22.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:22.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:22.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:22.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:22.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:22.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:22.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:22.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:22.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:22.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:22.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:22.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:22.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:22.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:25.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:25.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:25.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:25.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:25.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:25.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:25.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:25.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:25.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:25.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:25.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:25.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:25.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:25.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:25.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:25.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:25.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:25.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:25.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:25.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:25.714 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:02:25.715 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:02:25.718 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:02:25.723 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:02:27.215 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:02:27.216 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:02:27.216 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456147 2023-09-23T08:02:27.216 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456147 -le 1695457101 ]] 2023-09-23T08:02:27.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:02:27.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:02:27.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:02:28.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:28.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:28.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:28.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:28.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:28.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:28.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:28.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:28.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:28.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:28.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:28.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:28.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:28.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:28.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:28.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:28.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:28.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:28.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:28.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:29.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:29.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:30.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:30.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:30.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:30.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:30.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:30.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:30.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:30.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:30.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:30.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:30.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:30.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:30.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:30.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:30.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:30.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:30.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:30.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:31.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:31.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:31.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:31.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:31.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:31.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:31.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:31.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:31.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:31.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:31.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:31.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:31.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:32.954 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:32.947+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:02:32.954 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:32.947+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:02:33.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:33.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:33.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:33.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:33.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:33.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:33.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:33.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:33.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:33.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:02:33.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:33.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:33.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:33.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:33.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:33.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:33.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:33.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:33.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:33.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:33.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:33.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:02:33.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:33.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:33.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:33.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:33.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:33.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:33.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:33.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:33.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:33.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:33.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:33.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:34.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:34.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:34.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:34.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:34.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:34.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:34.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:34.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:34.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:34.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:34.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:34.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:35.482 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:35.475+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:02:36.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:36.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:36.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:36.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:36.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:36.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:36.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:36.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:36.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:36.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:36.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:36.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:37.226 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:02:37.226 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:02:37.238 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:02:37.240 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:02:38.731 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:02:38.731 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:02:38.731 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456158 2023-09-23T08:02:38.732 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456158 -le 1695457101 ]] 2023-09-23T08:02:38.732 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:02:38.732 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:02:38.732 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:02:39.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:39.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:39.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:39.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:39.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:39.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:39.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:39.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:39.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:39.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:39.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:39.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:45.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:45.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:45.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:45.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:45.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:45.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:45.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:45.921 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:45.915+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:02:45.922 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:45.915+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:02:45.922 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:45.915+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:02:45.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:45.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:45.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:45.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:45.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:45.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:45.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:45.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:45.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:45.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:46.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:46.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:46.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:46.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:46.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:46.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:46.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:46.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:46.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:46.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:46.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:46.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:46.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:46.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:46.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:46.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:46.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:46.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:47.824 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:02:47.811+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:02:47.824 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:02:47.811+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:02:47.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:47.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:47.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:47.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:47.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:47.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:47.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:47.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:47.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:47.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:47.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:47.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:47.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:47.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:47.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:47.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:48.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:48.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:48.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:48.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:48.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:48.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:48.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:48.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:48.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:48.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:48.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:48.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:48.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:48.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:48.764 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:02:48.766 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:02:48.767 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:02:48.771 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:02:48.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:48.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:48.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:48.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:48.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:48.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:48.929 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:48.923+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:02:48.929 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:48.923+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:02:49.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:49.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:49.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:49.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:49.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:49.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:49.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:49.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:49.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:49.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:49.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:49.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:50.134 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:02:50.134 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:02:50.134 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456170 2023-09-23T08:02:50.135 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456170 -le 1695457101 ]] 2023-09-23T08:02:50.135 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:02:50.135 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:02:50.135 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:02:50.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:50.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:50.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:50.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:50.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:50.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:50.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:50.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:50.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:50.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:50.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:50.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:50.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:50.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:50.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:51.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:51.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:51.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:51.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:51.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:51.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:51.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:51.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:51.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:51.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:51.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:51.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:51.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:51.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:51.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:51.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:51.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:51.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:52.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:52.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:52.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:52.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:52.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:52.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:52.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:52.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:52.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:52.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:52.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:52.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:53.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:53.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:53.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:53.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:53.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:53.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:53.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:53.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:53.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:53.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:53.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:53.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:53.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:53.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:53.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:53.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:53.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:53.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:53.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:53.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:53.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:53.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:53.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:53.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:53.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:02:53.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:53.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:53.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:53.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:56.537 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:56.531+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:02:57.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:57.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:57.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:57.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:57.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:57.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:57.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:57.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:02:57.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:02:57.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:02:57.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:02:57.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:02:57.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:02:57.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:02:57.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:02:57.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:02:57.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:02:57.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:02:58.714 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:58.703+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:02:58.714 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:02:58.703+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:00.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:00.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:00.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:00.139 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:03:00.144 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:03:00.145 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:03:00.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:00.148 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:03:00.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:00.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:00.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:00.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:00.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:00.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:00.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:00.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:00.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:00.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:00.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:00.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:00.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:00.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:00.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:00.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:00.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:00.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:00.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:00.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:00.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:00.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:00.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:00.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:00.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:00.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:00.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:00.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:00.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:00.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:00.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:00.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:00.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:00.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:00.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:00.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:00.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:00.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:00.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:00.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:00.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:00.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:00.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:01.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:01.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:01.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:01.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:01.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:01.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:01.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:01.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:01.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:01.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:01.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:01.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:01.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:01.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:01.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:01.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:01.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:01.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:01.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:01.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:01.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:01.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:01.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:01.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:01.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:01.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:01.433 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:03:01.433 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:03:01.434 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456181 2023-09-23T08:03:01.434 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456181 -le 1695457101 ]] 2023-09-23T08:03:01.434 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:03:01.435 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:03:01.435 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:03:01.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:01.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:01.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:02.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:02.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:02.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:02.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:02.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:02.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:02.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:02.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:02.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:02.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:02.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:02.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:02.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:02.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:02.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:02.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:02.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:02.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:02.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:02.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:03.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:03.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:03.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:03.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:03.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:03.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:03.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:03.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:03.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:03.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:03.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:03.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:03.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:03.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:03.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:03.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:04.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:04.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:04.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:04.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:04.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:04.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:04.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:04.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:04.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:04.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:04.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:04.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:04.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:04.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:05.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:05.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:05.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:05.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:05.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:05.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:05.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:05.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:05.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:05.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:05.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:05.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:07.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:07.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:07.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:07.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:07.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:07.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:07.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:07.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:07.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:07.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:07.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:07.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:07.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:07.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:07.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:07.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:07.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:07.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:08.591 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:08.587+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:03:08.591 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:08.587+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:09.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:09.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:09.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:09.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:09.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:09.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:09.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:09.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:09.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:09.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:09.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:09.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:09.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:09.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:10.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:10.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:10.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:10.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:10.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:10.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:10.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:10.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:10.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:10.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:10.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:10.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:10.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:10.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:10.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:10.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:10.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:10.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:10.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:11.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:10.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:11.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:11.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:11.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:11.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:11.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:11.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:11.444 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:03:11.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:11.454 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:03:11.454 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:03:11.454 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:03:11.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:11.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:11.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:11.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:11.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:11.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:11.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:11.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:11.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:11.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:11.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:11.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:11.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:11.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:11.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:11.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:11.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:11.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:11.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:11.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:11.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:11.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:11.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:11.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:11.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:11.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:11.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:11.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:11.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:12.769 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:03:12.774 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:03:12.776 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456192 2023-09-23T08:03:12.776 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456192 -le 1695457101 ]] 2023-09-23T08:03:12.776 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:03:12.776 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:03:12.776 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:03:13.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:12.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:13.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:13.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:13.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:13.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:13.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:13.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:13.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:13.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:13.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:13.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:13.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:13.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:13.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:13.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:13.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:13.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:15.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:15.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:15.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:15.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:15.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:15.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:15.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:15.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:15.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:15.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:15.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:15.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:15.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:15.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:15.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:15.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:15.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:15.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:15.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:15.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:15.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:15.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:15.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:20.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:20.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:20.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:20.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:20.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:20.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:20.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:20.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:20.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:20.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:20.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:20.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:21.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:21.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:21.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:21.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:21.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:21.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:21.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:21.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:21.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:21.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:21.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:21.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:21.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:21.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:21.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:21.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:21.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:21.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:21.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:21.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:22.777 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:03:22.778 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:03:22.783 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:03:22.812 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:03:24.155 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:03:24.155 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:03:24.157 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456204 2023-09-23T08:03:24.157 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456204 -le 1695457101 ]] 2023-09-23T08:03:24.157 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:03:24.157 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:03:24.157 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:03:24.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:24.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:24.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:24.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:24.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:24.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:24.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:24.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:24.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:24.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:24.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:24.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:24.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:24.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:24.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:24.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:24.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:24.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:27.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:27.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:27.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:27.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:27.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:27.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:27.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:27.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:27.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:27.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:27.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:27.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:27.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:27.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:27.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:27.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:27.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:27.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:28.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:28.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:28.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:28.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:28.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:28.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:28.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:28.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:28.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:28.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:28.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:28.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:28.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:28.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:28.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:28.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:28.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:28.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:28.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:28.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:28.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:29.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:29.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:29.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:29.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:29.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:29.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:29.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:29.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:29.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:29.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:29.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:29.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:29.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:29.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:29.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:29.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:31.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:31.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:31.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:31.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:31.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:31.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:31.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:31.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:31.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:31.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:31.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:31.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:31.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:31.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:31.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:31.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:31.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:31.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:32.279 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:32.274+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:03:32.279 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:32.274+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:32.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:32.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:32.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:32.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:32.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:32.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:32.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:32.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:32.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:32.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:32.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:32.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:32.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:33.045 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:33.038+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:33.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:33.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:33.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:33.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:33.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:33.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:33.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:33.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:33.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:33.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:33.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:33.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:33.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:33.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:33.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:33.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:33.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:33.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:33.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:33.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:33.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:33.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:33.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:33.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:33.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:33.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:33.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:33.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:33.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:33.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:33.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:33.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:34.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:34.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:34.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:34.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:34.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:34.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:34.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:34.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:34.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:34.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:34.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:34.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:34.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:34.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:34.172 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:03:34.177 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:03:34.182 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:03:34.182 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:03:35.581 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:35.574+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:03:35.581 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:35.574+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:03:35.581 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:35.574+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:35.587 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:03:35.589 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:03:35.590 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456215 2023-09-23T08:03:35.590 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456215 -le 1695457101 ]] 2023-09-23T08:03:35.590 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:03:35.590 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:03:35.590 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:03:35.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:35.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:35.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:35.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:36.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:36.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:36.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:36.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:36.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:36.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:36.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:36.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:36.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:36.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:36.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:36.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:36.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:36.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:36.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:36.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:36.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:36.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:36.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:36.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:37.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:37.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:37.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:37.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:37.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:37.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:37.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:37.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:37.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:37.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:37.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:37.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:37.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:37.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:37.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:37.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:37.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:37.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:37.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:37.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:37.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:37.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:38.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:38.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:38.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:38.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:38.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:38.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:38.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:38.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:38.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:38.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:38.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:38.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:38.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:38.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:38.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:38.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:40.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:40.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:40.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:40.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:40.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:40.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:40.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:40.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:40.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:40.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:40.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:40.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:40.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:40.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:40.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:40.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:40.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:40.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:40.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:40.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:42.642 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:42.638+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:43.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:43.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:43.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:43.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:43.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:43.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:43.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:43.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:43.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:43.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:43.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:43.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:45.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:45.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:45.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:45.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:45.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:45.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:45.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:45.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:45.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:45.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:45.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:45.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:45.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:45.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:45.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:45.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:45.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:45.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:45.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:45.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:45.256 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:45.250+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:03:45.592 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:03:45.593 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:03:45.600 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:03:45.633 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:03:46.016 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:46.010+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:46.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:46.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:46.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:46.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:46.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:46.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:46.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:46.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:46.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:46.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:46.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:46.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:46.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:46.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:46.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:46.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:46.950 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:03:46.950 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:03:46.951 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456226 2023-09-23T08:03:46.951 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456226 -le 1695457101 ]] 2023-09-23T08:03:46.951 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:03:46.951 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:03:46.952 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:03:47.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:47.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:47.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:47.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:47.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:47.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:47.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:47.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:47.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:47.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:47.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:47.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:47.787 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:47.782+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:03:47.788 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:47.782+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:49.959 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:49.954+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:50.048 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:50.038+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:50.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:50.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:50.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:50.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:50.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:50.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:50.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:50.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:50.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:50.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:50.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:50.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:50.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:50.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:52.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:52.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:52.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:52.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:52.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:52.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:52.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:52.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:52.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:52.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:52.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:52.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:52.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:52.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:52.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:52.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:52.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:52.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:53.432 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:53.426+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:03:53.432 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:53.426+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:53.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:53.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:53.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:53.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:53.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:53.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:53.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:53.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:53.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:53.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:53.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:03:53.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:53.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:53.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:53.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:53.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:53.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:53.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:53.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:53.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:53.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:53.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:53.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:54.233 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:03:54.226+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:03:54.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:54.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:54.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:54.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:54.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:54.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:54.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:54.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:54.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:54.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:54.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:54.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:56.961 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:03:56.961 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:03:56.966 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:03:56.996 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:03:57.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:57.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:57.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:57.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:57.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:57.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:57.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:57.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:57.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:57.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:57.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:57.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:57.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:57.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:57.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:57.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:58.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:58.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:58.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:58.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:58.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:58.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:58.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:58.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:58.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:58.381 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:03:58.381 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:03:58.382 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456238 2023-09-23T08:03:58.382 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456238 -le 1695457101 ]] 2023-09-23T08:03:58.382 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:03:58.383 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:03:58.383 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:03:58.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:58.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:58.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:58.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:58.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:58.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:58.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:58.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:58.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:03:59.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:58.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:03:59.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:59.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:03:59.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:59.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:03:59.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:59.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:03:59.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:59.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:03:59.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:59.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:03:59.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:59.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:03:59.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:59.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:03:59.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:59.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:03:59.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:59.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:03:59.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:03:59.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:02.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:02.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:02.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:02.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:02.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:02.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:02.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:02.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:02.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:02.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:02.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:02.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:02.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:02.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:03.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:03.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:03.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:03.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:03.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:03.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:03.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:03.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:03.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:03.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:03.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:03.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:03.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:03.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:03.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:03.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:03.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:03.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:03.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:03.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:04.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:04.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:04.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:04.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:04.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:04.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:04.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:04.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:04.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:04.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:04.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:04.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:05.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:05.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:05.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:05.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:05.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:05.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:05.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:05.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:05.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:05.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:05.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:05.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:06.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:06.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:06.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:06.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:06.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:06.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:06.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:06.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:06.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:06.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:06.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:06.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:07.590 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:07.586+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:04:07.590 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:07.586+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:04:08.400 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:04:08.401 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:04:08.406 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:04:08.406 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:04:08.569 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:08.566+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:04:08.570 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:08.566+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:04:08.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:08.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:08.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:08.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:08.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:08.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:08.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:08.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:08.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:08.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:08.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:08.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:08.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:08.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:08.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:08.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:08.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:08.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:09.807 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:04:09.812 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:04:09.813 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456249 2023-09-23T08:04:09.813 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456249 -le 1695457101 ]] 2023-09-23T08:04:09.813 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:04:09.813 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:04:09.813 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:04:11.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:11.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:11.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:11.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:11.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:11.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:11.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:11.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:11.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:11.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:11.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:11.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:11.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:11.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:11.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:11.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:11.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:11.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:11.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:11.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:15.853 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:15.850+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:04:15.853 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:15.850+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:04:15.853 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:15.850+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:04:16.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:16.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:16.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:16.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:16.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:16.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:16.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:16.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:16.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:16.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:16.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:04:16.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:16.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:16.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:16.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:16.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:16.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:16.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:16.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:16.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:16.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:16.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:16.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:17.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:17.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:17.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:17.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:17.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:17.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:17.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:17.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:17.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:17.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:17.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:17.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:18.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:18.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:18.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:18.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:18.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:18.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:18.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:18.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:18.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:18.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:18.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:18.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:18.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:18.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:18.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:18.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:19.820 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:04:19.821 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:04:19.821 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:04:19.830 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:04:21.159 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:04:21.166 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:04:21.175 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456261 2023-09-23T08:04:21.175 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456261 -le 1695457101 ]] 2023-09-23T08:04:21.175 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:04:21.175 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:04:21.175 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:04:21.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:21.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:21.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:21.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:21.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:21.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:21.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:21.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:21.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:04:21.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:21.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:21.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:21.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:21.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:21.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:21.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:21.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:21.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:21.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:21.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:21.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:23.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:23.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:23.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:23.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:23.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:23.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:23.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:23.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:23.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:23.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:23.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:23.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:23.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:23.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:23.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:23.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:23.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:23.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:23.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:26.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:26.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:26.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:26.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:26.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:26.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:26.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:26.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:26.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:26.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:26.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:26.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:26.800 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:26.797+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:04:26.801 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:26.797+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:04:27.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:27.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:27.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:27.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:27.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:27.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:27.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:27.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:27.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:27.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:27.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:27.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:27.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:27.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:27.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:27.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:27.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:27.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:27.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:27.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:27.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:28.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:28.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:28.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:28.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:28.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:28.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:28.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:28.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:28.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:28.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:28.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:28.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:04:28.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:28.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:28.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:28.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:28.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:28.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:28.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:28.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:28.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:28.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:28.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:28.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:28.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:28.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:28.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:28.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:28.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:28.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:29.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:29.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:29.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:29.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:29.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:29.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:29.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:29.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:29.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:29.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:29.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:29.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:29.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:29.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:29.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:29.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:29.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:29.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:29.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:29.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:30.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:30.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:30.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:30.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:30.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:30.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:30.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:30.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:30.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:30.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:30.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:30.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:30.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:30.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:30.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:30.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:30.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:30.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:31.190 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:04:31.191 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:04:31.201 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:04:31.211 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:04:31.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:31.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:31.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:31.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:31.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:31.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:31.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:31.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:31.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:31.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:31.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:31.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:32.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:32.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:32.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:32.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:32.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:32.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:32.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:32.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:32.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:32.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:32.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:32.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:32.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:32.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:32.545 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:04:32.545 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:04:32.551 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456272 2023-09-23T08:04:32.551 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456272 -le 1695457101 ]] 2023-09-23T08:04:32.551 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:04:32.551 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:04:32.551 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:04:32.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:32.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:32.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:32.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:34.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:34.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:34.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:34.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:34.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:34.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:34.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:34.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:34.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:34.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:34.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:34.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:35.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:35.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:35.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:35.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:35.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:35.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:35.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:35.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:35.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:35.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:35.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:35.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:35.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:35.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:35.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:35.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:35.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:35.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:35.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:35.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:38.675 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:38.673+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:04:38.675 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:38.673+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:04:41.834 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:41.829+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:04:42.559 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:04:42.564 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:04:42.570 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:04:42.573 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:04:43.730 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:04:43.750 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:04:43.752 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456283 2023-09-23T08:04:43.752 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456283 -le 1695457101 ]] 2023-09-23T08:04:43.752 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:04:43.752 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:04:43.752 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:04:45.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:45.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:45.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:45.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:45.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:45.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:45.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:45.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:45.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:45.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:45.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:45.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:45.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:45.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:45.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:45.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:45.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:45.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:45.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:45.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:45.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:45.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:46.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:46.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:46.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:46.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:46.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:46.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:46.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:46.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:46.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:46.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:46.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:46.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:46.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:46.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:46.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:46.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:46.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:46.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:46.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:46.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:48.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:48.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:48.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:48.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:48.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:48.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:48.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:48.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:48.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:48.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:48.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:48.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:48.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:48.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:48.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:48.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:48.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:48.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:50.060 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:04:50.057+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:04:53.774 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:04:53.775 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:04:53.775 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:04:53.784 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:04:53.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:53.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:53.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:53.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:53.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:53.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:53.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:53.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:53.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:53.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:53.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:53.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:53.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:53.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:53.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:53.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:53.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:53.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:53.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:53.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:55.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:55.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:55.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:55.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:55.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:55.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:55.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:55.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:55.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:55.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:55.149 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:04:55.149 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:04:55.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456295 2023-09-23T08:04:55.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456295 -le 1695457101 ]] 2023-09-23T08:04:55.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:04:55.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:04:55.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:04:55.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:55.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:55.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:55.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:55.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:55.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:55.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:55.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:55.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:55.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:56.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:04:56.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:56.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:56.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:56.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:56.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:56.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:56.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:56.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:56.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:56.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:56.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:56.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:56.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:56.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:56.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:56.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:56.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:56.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:56.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:56.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:57.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:57.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:57.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:57.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:57.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:57.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:57.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:57.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:57.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:57.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:57.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:57.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:57.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:57.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:57.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:57.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:59.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:59.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:59.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:59.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:59.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:59.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:59.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:04:59.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:59.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:59.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:04:59.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:59.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:59.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:59.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:59.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:59.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:04:59.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:04:59.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:04:59.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:04:59.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:04:59.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:04:59.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:04:59.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:04:59.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:04:59.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:01.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:01.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:01.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:01.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:01.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:01.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:01.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:01.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:01.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:01.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:01.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:01.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:01.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:01.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:01.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:01.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:02.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:02.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:02.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:02.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:02.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:02.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:02.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:02.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:02.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:02.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:02.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:02.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:02.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:02.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:02.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:02.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:02.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:02.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:02.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:02.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:02.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:02.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:02.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:02.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:02.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:02.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:02.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:02.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:02.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:02.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:02.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:02.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:02.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:02.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:02.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:02.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:03.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:03.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:03.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:03.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:03.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:03.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:03.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:03.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:03.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:03.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:03.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:03.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:03.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:03.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:03.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:03.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:03.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:03.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:03.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:03.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:03.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:04.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:04.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:04.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:04.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:04.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:04.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:04.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:04.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:04.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:04.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:04.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:04.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:05.174 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:05:05.183 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:05:05.183 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:05:05.197 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:05:06.712 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:05:06.712 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:05:06.713 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456306 2023-09-23T08:05:06.713 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456306 -le 1695457101 ]] 2023-09-23T08:05:06.713 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:05:06.713 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:05:06.713 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:05:08.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:08.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:08.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:08.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:08.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:08.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:08.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:08.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:08.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:08.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:08.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:08.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:08.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:09.038 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:09.037+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:09.039 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:09.037+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:09.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:09.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:09.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:09.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:09.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:09.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:09.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:09.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:09.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:05:09.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:09.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:09.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:09.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:09.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:09.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:09.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:09.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:09.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:09.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:10.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:10.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:10.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:10.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:10.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:10.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:10.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:10.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:10.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:10.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:10.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:10.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:10.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:10.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:10.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:10.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:10.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:10.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:15.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:15.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:15.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:15.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:15.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:15.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:15.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:15.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:15.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:15.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:15.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:15.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:16.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:16.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:16.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:16.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:16.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:16.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:16.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:16.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:16.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:16.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:16.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:16.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:16.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:16.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:16.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:16.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:16.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:16.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:16.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:16.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:16.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:16.716 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:05:16.716 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:05:16.729 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:05:16.735 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:05:17.250 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:17.249+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:05:17.250 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:17.249+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:05:17.262 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:17.261+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:05:17.262 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:17.261+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:17.263 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:17.261+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:17.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:17.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:17.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:17.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:17.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:17.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:17.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:17.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:17.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:17.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:17.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:17.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:17.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:17.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:17.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:17.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:17.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:17.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:17.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:17.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:17.966 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:17.961+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:05:17.966 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:17.961+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:17.966 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:17.961+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:18.008 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:05:18.009 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:05:18.009 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456318 2023-09-23T08:05:18.009 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456318 -le 1695457101 ]] 2023-09-23T08:05:18.009 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:05:18.010 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:05:18.010 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:05:21.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:21.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:21.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:21.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:21.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:21.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:21.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:21.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:21.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:21.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:21.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:21.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:21.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:21.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:21.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:21.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:22.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:22.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:22.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:22.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:22.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:22.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:22.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:22.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:22.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:22.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:22.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:22.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:22.855 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:22.849+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:05:22.856 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:22.849+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:22.856 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:22.849+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:24.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:24.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:24.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:24.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:24.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:24.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:24.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:24.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:24.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:24.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:24.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:24.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:24.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:24.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:24.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:25.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:25.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:25.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:25.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:25.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:25.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:25.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:25.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:25.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:25.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:25.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:25.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:25.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:25.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:25.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:25.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:25.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:25.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:25.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:25.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:26.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:26.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:26.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:26.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:26.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:26.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:26.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:26.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:26.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:26.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:26.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:05:26.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:26.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:26.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:26.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:26.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:26.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:26.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:26.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:26.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:26.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:26.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:26.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:26.227 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:26.224+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:05:26.279 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:26.276+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:05:26.279 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:26.276+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:26.279 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:26.276+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:27.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:27.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:27.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:27.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:27.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:27.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:27.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:27.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:27.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:27.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:27.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:27.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:28.024 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:05:28.025 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:05:28.025 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:05:28.027 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:28.024+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:28.027 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:28.024+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:28.035 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:05:28.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:05:28.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:28.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:28.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:28.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:28.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:28.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:28.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:28.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:28.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:28.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:28.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:28.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:29.527 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:05:29.529 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:05:29.543 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456329 2023-09-23T08:05:29.543 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456329 -le 1695457101 ]] 2023-09-23T08:05:29.543 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:05:29.543 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:05:29.543 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:05:29.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:29.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:29.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:29.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:29.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:29.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:29.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:29.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:29.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:29.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:29.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:29.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:30.960 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:30.956+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:05:30.961 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:30.956+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:30.961 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:30.956+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:31.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:31.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:31.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:31.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:31.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:31.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:31.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:31.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:31.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:31.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:31.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:31.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:33.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:33.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:33.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:33.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:33.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:33.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:33.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:33.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:33.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:33.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:33.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:33.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:33.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:33.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:39.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:39.339 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:39.336+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:05:39.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:39.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:39.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:39.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:39.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:39.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:39.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:39.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:39.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:39.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:39.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:39.566 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:05:39.573 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:05:39.576 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:05:39.585 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:05:40.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:40.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:40.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:40.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:40.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:40.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:40.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:40.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:40.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:05:40.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:40.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:40.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:40.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:40.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:40.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:40.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:40.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:40.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:40.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:40.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:40.966 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:05:40.967 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:05:40.968 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456340 2023-09-23T08:05:40.968 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456340 -le 1695457101 ]] 2023-09-23T08:05:40.968 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:05:40.968 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:05:40.968 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:05:40.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:40.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:40.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:40.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:40.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:40.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:40.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:40.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:40.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:41.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:41.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:41.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:41.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:42.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:42.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:42.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:42.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:42.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:42.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:42.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:42.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:42.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:42.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:42.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:42.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:42.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:42.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:42.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:42.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:42.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:42.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:42.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:43.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:43.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:43.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:43.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:43.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:43.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:43.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:43.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:43.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:43.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:43.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:43.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:43.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:43.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:43.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:43.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:44.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:44.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:44.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:44.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:44.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:44.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:44.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:44.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:44.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:44.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:44.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:44.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:44.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:44.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:44.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:45.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:45.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:45.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:45.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:45.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:45.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:45.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:45.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:45.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:45.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:45.505 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:45.500+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:05:45.505 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:45.500+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:05:45.505 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:45.500+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:05:45.518 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:45.512+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:05:45.519 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:45.516+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:45.519 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:45.516+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:45.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:45.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:45.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:45.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:45.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:45.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:45.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:45.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:45.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:46.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:46.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:46.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:46.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:46.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:46.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:46.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:46.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:46.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:46.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:46.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:46.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:46.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:46.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:46.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:46.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:46.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:46.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:46.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:46.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:47.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:47.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:48.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:48.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:48.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:48.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:48.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:48.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:48.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:48.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:48.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:05:48.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:48.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:48.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:48.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:48.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:48.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:48.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:48.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:48.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:48.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:48.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:49.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:49.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:49.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:49.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:49.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:49.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:49.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:49.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:49.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:49.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:49.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:49.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:49.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:49.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:49.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:49.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:50.339 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:50.336+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:50.339 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:50.336+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:50.496 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:50.492+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:50.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:50.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:50.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:50.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:50.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:50.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:50.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:50.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:50.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:50.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:50.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:50.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:50.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:50.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:50.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:50.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:50.970 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:05:50.970 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:05:50.991 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:05:50.994 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:05:51.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:51.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:51.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:51.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:51.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:51.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:51.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:51.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:51.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:51.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:51.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:51.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:51.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:51.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:51.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:51.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:52.080 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:05:52.081 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:05:52.081 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456352 2023-09-23T08:05:52.081 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456352 -le 1695457101 ]] 2023-09-23T08:05:52.082 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:05:52.082 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:05:52.082 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:05:53.285 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:53.280+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:05:53.285 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:53.280+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:53.285 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:53.280+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:55.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:05:55.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:55.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:55.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:55.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:55.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:55.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:55.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:55.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:55.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:55.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:55.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:55.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:55.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:55.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:56.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:56.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:56.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:56.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:56.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:56.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:56.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:56.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:56.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:56.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:56.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:56.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:56.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:56.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:56.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:56.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:56.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:56.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:57.765 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:57.760+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:05:57.765 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:57.760+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:05:57.765 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:57.760+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:58.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:05:58.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:58.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:58.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:58.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:58.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:58.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:58.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:58.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:58.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:58.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:05:58.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:58.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:58.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:05:58.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:58.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:58.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:05:58.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:05:58.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:58.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:05:59.877 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:05:59.872+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:05:59.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:59.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:05:59.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:59.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:05:59.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:59.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:05:59.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:59.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:05:59.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:05:59.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:00.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:00.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:00.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:00.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:00.039 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:00.036+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:06:00.039 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:00.036+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:06:02.087 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:06:02.087 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:06:02.088 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:06:02.124 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:06:03.419 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:06:03.420 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:06:03.421 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456363 2023-09-23T08:06:03.421 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456363 -le 1695457101 ]] 2023-09-23T08:06:03.421 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:06:03.421 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:06:03.421 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:06:03.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:03.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:03.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:03.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:03.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:03.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:03.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:03.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:03.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:03.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:03.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:03.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:04.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:04.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:04.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:04.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:04.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:04.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:04.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:04.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:04.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:04.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:04.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:04.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:04.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:04.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:04.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:04.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:04.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:04.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:07.829 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:07.824+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:06:07.841 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:07.836+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:06:07.842 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:07.836+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:06:07.842 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:07.836+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:06:11.083 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:11.080+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:06:11.105 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:11.080+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:06:11.106 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:11.080+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:06:11.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:11.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:11.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:11.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:11.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:11.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:11.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:11.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:11.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:11.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:11.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:11.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:11.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:11.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:11.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:11.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:11.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:11.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:11.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:11.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:13.423 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:06:13.423 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:06:13.428 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:06:13.444 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:06:14.801 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:06:14.812 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:06:14.813 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456374 2023-09-23T08:06:14.814 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456374 -le 1695457101 ]] 2023-09-23T08:06:14.814 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:06:14.814 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:06:14.814 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:06:15.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:15.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:15.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:15.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:15.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:15.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:16.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:16.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:16.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:16.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:16.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:16.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:16.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:16.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:16.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:16.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:16.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:16.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:16.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:16.872 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:16.868+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:06:17.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:17.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:17.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:17.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:17.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:17.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:17.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:17.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:17.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:17.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:17.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:17.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:17.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:17.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:19.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:06:19.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:19.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:19.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:19.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:19.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:19.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:19.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:19.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:19.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:19.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:19.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:19.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:06:19.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:19.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:19.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:19.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:19.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:19.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:19.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:19.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:19.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:19.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:19.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:19.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:20.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:19.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:20.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:20.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:20.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:20.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:20.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:20.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:20.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:20.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:20.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:20.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:20.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:20.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:20.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:20.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:20.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:20.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:20.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:06:20.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:20.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:20.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:20.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:20.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:20.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:20.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:20.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:20.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:22.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:22.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:22.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:22.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:22.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:22.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:22.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:22.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:22.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:22.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:22.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:22.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:22.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:22.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:22.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:22.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:23.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:23.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:23.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:23.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:23.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:23.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:23.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:23.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:23.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:23.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:23.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:23.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:23.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:23.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:23.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:23.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:23.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:23.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:23.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:23.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:24.816 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:06:24.818 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:06:24.826 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:06:24.828 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:06:24.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:24.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:24.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:24.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:24.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:24.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:25.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:24.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:25.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:24.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:25.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:25.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:25.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:25.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:25.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:25.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:25.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:25.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:25.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:25.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:25.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:25.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:25.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:25.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:25.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:25.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:26.131 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:06:26.133 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:06:26.135 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456386 2023-09-23T08:06:26.135 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456386 -le 1695457101 ]] 2023-09-23T08:06:26.135 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:06:26.135 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:06:26.135 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:06:26.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:26.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:26.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:26.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:26.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:26.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:26.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:26.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:26.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:26.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:26.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:26.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:26.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:26.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:26.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:26.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:26.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:26.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:26.685 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:26.680+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:06:28.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:28.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:28.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:28.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:28.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:28.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:28.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:28.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:28.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:28.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:28.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:28.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:28.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:28.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:28.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:28.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:28.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:28.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:28.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:28.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:30.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:30.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:30.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:30.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:30.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:30.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:30.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:30.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:30.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:30.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:30.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:30.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:32.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:32.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:32.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:32.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:32.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:32.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:32.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:32.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:32.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:32.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:32.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:32.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:33.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:33.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:33.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:33.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:33.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:33.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:33.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:33.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:33.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:33.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:33.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:33.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:33.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:33.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:33.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:33.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:33.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:33.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:33.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:33.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:34.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:06:34.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:34.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:34.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:34.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:34.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:34.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:34.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:34.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:34.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:34.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:34.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:34.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:34.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:34.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:34.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:34.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:34.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:34.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:34.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:34.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:36.137 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:06:36.138 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:06:36.138 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:06:36.138 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:06:36.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:36.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:36.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:36.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:36.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:36.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:36.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:36.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:36.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:36.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:36.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:36.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:36.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:36.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:36.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:36.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:36.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:37.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:37.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:37.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:37.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:37.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:37.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:37.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:37.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:37.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:37.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:37.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:37.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:37.478 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:06:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:06:37.501 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456397 2023-09-23T08:06:37.501 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456397 -le 1695457101 ]] 2023-09-23T08:06:37.501 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:06:37.501 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:06:37.501 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:06:38.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:38.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:38.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:38.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:38.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:38.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:38.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:38.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:38.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:38.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:38.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:38.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:38.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:38.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:38.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:38.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:39.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:06:39.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:39.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:39.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:39.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:39.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:39.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:39.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:39.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:39.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:39.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:39.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:39.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:40.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:40.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:40.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:40.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:40.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:40.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:40.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:40.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:40.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:40.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:40.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:40.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:40.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:40.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:40.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:40.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:40.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:40.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:40.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:40.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:40.875 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:40.871+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:06:40.888 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:40.883+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:06:40.902 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:40.895+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:06:40.902 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:40.895+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:06:40.902 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:40.895+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:06:42.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:42.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:42.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:42.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:42.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:42.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:42.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:42.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:42.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:42.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:42.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:42.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:42.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:42.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:42.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:42.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:44.781 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:44.775+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:06:44.781 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:44.775+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:06:44.781 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:44.775+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:06:44.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:44.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:44.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:44.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:44.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:44.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:44.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:44.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:44.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:44.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:44.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:44.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:44.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:44.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:46.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:46.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:46.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:46.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:46.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:46.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:46.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:46.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:46.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:46.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:46.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:46.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:46.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:46.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:46.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:46.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:46.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:46.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:46.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:46.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:47.509 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:06:47.509 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:06:47.514 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:06:47.540 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:06:48.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:47.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:06:48.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:47.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:48.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:48.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:48.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:48.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:48.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:48.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:48.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:48.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:48.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:48.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:48.833 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:06:48.842 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:06:48.843 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456408 2023-09-23T08:06:48.844 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456408 -le 1695457101 ]] 2023-09-23T08:06:48.844 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:06:48.844 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:06:48.844 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:06:48.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:48.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:48.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:48.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:48.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:48.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:48.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:48.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:48.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:48.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:48.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:49.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:49.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:49.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:49.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:49.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:49.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:49.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:49.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:49.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:49.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:53.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:53.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:53.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:53.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:54.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:54.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:54.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:54.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:54.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:54.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:54.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:54.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:54.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:54.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:54.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:54.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:54.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:54.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:55.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:55.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:55.682 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:55.679+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:06:55.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:55.690 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:55.687+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:06:55.690 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:55.687+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:06:55.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:55.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:55.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:55.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:55.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:55.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:55.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:06:55.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:06:55.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:55.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:55.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:55.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:55.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:55.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:55.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:55.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:55.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:55.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:55.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:56.345 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:56.339+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:06:56.345 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:56.339+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:06:56.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:56.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:06:56.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:56.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:56.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:56.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:56.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:56.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:56.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:56.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:56.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:56.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:56.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:56.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:56.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:56.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:56.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:56.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:06:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:06:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:06:58.878 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:06:59.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:59.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:59.207 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:59.203+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:06:59.207 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:59.203+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:06:59.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:59.220 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:59.215+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:06:59.220 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:59.215+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:06:59.220 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:06:59.215+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:06:59.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:59.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:59.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:59.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:59.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:06:59.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:06:59.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:06:59.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:06:59.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:06:59.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:06:59.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:06:59.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:06:59.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:06:59.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:06:59.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:00.131 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:07:00.131 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:07:00.132 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456420 2023-09-23T08:07:00.132 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456420 -le 1695457101 ]] 2023-09-23T08:07:00.132 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:07:00.133 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:07:00.133 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:07:03.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:03.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:03.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:03.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:03.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:03.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:03.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:03.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:03.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:03.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:03.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:03.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:04.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:04.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:04.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:04.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:04.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:04.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:04.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:04.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:04.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:04.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:04.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:04.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:04.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:04.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:04.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:04.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:04.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:04.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:04.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:04.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:05.270 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:05.267+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:07:05.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:05.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:05.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:05.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:06.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:06.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:06.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:06.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:06.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:06.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:06.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:06.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:06.190 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:06.183+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:07:06.190 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:06.183+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:07:06.191 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:06.183+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:07:06.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:06.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:06.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:06.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:06.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:06.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:06.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:06.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:06.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:06.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:06.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:07.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:07.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:07.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:07.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:07.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:07.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:07.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:07.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:07.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:07.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:07.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:07.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:07.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:07.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:07.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:07.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:08.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:08.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:08.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:08.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:08.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:08.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:08.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:08.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:08.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:08.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:08.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:08.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:08.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:08.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:08.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:08.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:08.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:08.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:09.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:09.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:09.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:09.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:09.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:09.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:09.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:09.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:09.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:09.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:09.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:09.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:09.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:09.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:09.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:09.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:09.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:09.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:09.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:09.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:09.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:10.148 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:07:10.148 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:07:10.167 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:07:10.180 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:07:10.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:10.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:10.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:10.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:10.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:10.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:11.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:11.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:11.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:11.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:11.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:11.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:11.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:11.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:11.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:11.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:11.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:11.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:11.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:11.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:11.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:11.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:11.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:11.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:11.471 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:07:11.471 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:07:11.472 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456431 2023-09-23T08:07:11.473 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456431 -le 1695457101 ]] 2023-09-23T08:07:11.473 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:07:11.473 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:07:11.473 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:07:12.328 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:12.323+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:07:12.329 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:12.323+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:07:12.332 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:12.327+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:07:12.332 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:12.327+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:07:12.332 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:12.327+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:07:13.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:13.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:13.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:13.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:13.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:13.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:13.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:13.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:13.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:13.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:13.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:13.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:13.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:13.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:13.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:13.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:13.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:14.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:14.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:14.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:14.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:14.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:14.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:14.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:14.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:14.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:14.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:14.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:14.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:15.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:15.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:15.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:15.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:15.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:15.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:15.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:15.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:15.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:15.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:15.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:15.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:15.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:15.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:15.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:15.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:15.879 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:15.875+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:07:15.879 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:15.875+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:07:15.879 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:15.875+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:07:18.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:18.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:18.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:18.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:18.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:18.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:18.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:18.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:18.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:18.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:18.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:18.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:18.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:18.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:18.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:18.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:18.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:18.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:18.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:18.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:19.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:19.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:19.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:19.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:19.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:19.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:19.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:19.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:19.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:19.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:19.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:19.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:19.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:19.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:19.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:19.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:19.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:19.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:19.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:19.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:21.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:21.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:21.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:21.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:21.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:21.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:21.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:21.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:21.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:21.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:21.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:21.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:21.478 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:07:21.479 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:07:21.484 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:07:21.500 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:07:22.847 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:07:22.847 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:07:22.848 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456442 2023-09-23T08:07:22.848 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456442 -le 1695457101 ]] 2023-09-23T08:07:22.849 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:07:22.849 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:07:22.849 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:07:23.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:23.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:23.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:23.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:23.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:23.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:23.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:23.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:23.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:23.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:23.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:23.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:23.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:23.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:23.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:23.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:23.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:23.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:23.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:23.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:24.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:24.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:24.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:24.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:24.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:24.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:24.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:24.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:24.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:24.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:24.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:24.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:24.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:24.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:24.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:24.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:24.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:24.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:25.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:07:25.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:25.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:25.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:25.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:25.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:25.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:25.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:25.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:25.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:25.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:25.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:25.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:07:25.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:25.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:25.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:25.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:25.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:25.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:25.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:25.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:25.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:25.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:25.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:25.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:26.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:26.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:26.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:26.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:26.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:26.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:26.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:26.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:26.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:26.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:26.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:26.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:28.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:28.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:28.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:28.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:28.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:28.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:28.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:28.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:28.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:28.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:28.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:28.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:28.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:28.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:28.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:28.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:28.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:28.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:28.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:07:28.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:28.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:28.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:28.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:28.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:28.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:28.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:28.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:28.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:28.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:28.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:31.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:31.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:31.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:31.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:31.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:31.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:31.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:31.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:31.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:31.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:31.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:31.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:32.856 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:07:32.856 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:07:32.857 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:07:32.875 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:07:34.110 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:07:34.118 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:07:34.119 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456454 2023-09-23T08:07:34.119 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456454 -le 1695457101 ]] 2023-09-23T08:07:34.119 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:07:34.119 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:07:34.119 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:07:35.082 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:35.075+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:07:35.082 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:35.075+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:07:35.082 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:35.075+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:07:35.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:35.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:35.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:35.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:35.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:35.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:35.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:35.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:35.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:35.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:35.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:35.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:38.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:38.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:38.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:38.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:38.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:38.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:38.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:38.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:38.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:38.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:38.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:38.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:38.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:38.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:38.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:38.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:39.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:39.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:39.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:39.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:39.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:39.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:39.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:39.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:39.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:39.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:39.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:39.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:39.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:39.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:40.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:40.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:40.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:40.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:40.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:40.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:40.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:40.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:40.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:40.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:40.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:40.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:40.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:40.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:40.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:40.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:40.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:40.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:40.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:40.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:41.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:41.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:41.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:41.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:41.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:41.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:41.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:41.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:41.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:41.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:41.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:41.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:41.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:41.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:41.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:41.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:41.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:41.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:41.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:41.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:41.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:42.282 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:42.274+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:07:42.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:42.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:42.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:42.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:42.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:42.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:42.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:42.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:42.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:42.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:42.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:42.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:43.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:43.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:43.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:43.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:43.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:43.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:43.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:43.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:43.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:43.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:43.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:43.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:43.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:43.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:43.671 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:43.666+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:07:43.671 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:43.666+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:07:44.137 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:07:44.433 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:07:44.433 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:07:44.434 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:07:44.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:44.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:44.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:44.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:44.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:44.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:44.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:44.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:44.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:44.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:44.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:44.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:44.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:44.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:45.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:45.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:45.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:45.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:45.604 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:07:45.606 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:07:45.607 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456465 2023-09-23T08:07:45.607 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456465 -le 1695457101 ]] 2023-09-23T08:07:45.608 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:07:45.608 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:07:45.608 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:07:47.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:07:47.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:47.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:47.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:47.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:47.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:47.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:47.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:47.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:47.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:47.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:47.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:47.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:48.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:48.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:48.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:48.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:48.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:48.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:48.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:48.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:48.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:48.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:48.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:48.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:48.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:48.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:48.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:48.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:48.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:48.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:51.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:51.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:51.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:51.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:51.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:51.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:51.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:51.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:51.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:51.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:51.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:51.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:51.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:51.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:51.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:51.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:51.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:51.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:52.093 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:52.086+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:07:52.093 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:07:52.086+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:07:52.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:52.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:52.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:52.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:52.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:52.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:52.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:52.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:52.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:52.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:52.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:52.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:52.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:52.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:52.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:52.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:52.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:52.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:53.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:53.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:53.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:53.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:53.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:53.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:53.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:53.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:53.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:53.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:53.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:53.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:53.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:53.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:53.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:53.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:53.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:53.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:53.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:53.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:07:53.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:53.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:53.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:53.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:53.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:53.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:53.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:53.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:53.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:53.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:53.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:53.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:07:53.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:07:53.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:53.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:53.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:53.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:53.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:53.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:53.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:53.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:53.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:54.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:54.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:54.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:54.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:54.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:54.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:54.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:54.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:54.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:54.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:54.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:54.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:54.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:54.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:55.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:55.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:07:55.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:55.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:07:55.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:55.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:07:55.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:55.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:07:55.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:55.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:07:55.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:55.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:07:55.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:55.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:07:55.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:55.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:07:55.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:07:55.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:07:55.610 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:07:55.610 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:07:55.618 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:07:55.618 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:07:57.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:07:57.217 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:07:57.219 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456477 2023-09-23T08:07:57.219 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456477 -le 1695457101 ]] 2023-09-23T08:07:57.219 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:07:57.219 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:07:57.219 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:08:00.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:00.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:00.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:00.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:00.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:00.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:00.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:00.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:00.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:00.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:00.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:00.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:01.298 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:01.290+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:08:01.304 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:01.298+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:08:01.304 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:01.298+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:08:01.852 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:01.846+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:08:01.852 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:01.846+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:08:01.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:01.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:01.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:01.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:01.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:01.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:01.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:01.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:01.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:01.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:01.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:01.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:01.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:01.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:01.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:01.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:01.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:01.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:01.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:01.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:02.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:02.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:02.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:02.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:02.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:02.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:02.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:02.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:02.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:02.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:02.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:02.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:02.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:02.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:02.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:02.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:02.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:02.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:02.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:02.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:02.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:02.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:02.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:02.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:02.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:03.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:03.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:03.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:03.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:03.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:03.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:03.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:03.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:03.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:03.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:03.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:03.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:03.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:03.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:03.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:03.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:03.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:03.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:03.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:03.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:03.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:03.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:03.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:03.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:03.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:03.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:03.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:04.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:04.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:03.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:04.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:04.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:04.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:04.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:04.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:04.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:04.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:04.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:04.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:04.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:04.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:04.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:05.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:05.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:05.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:05.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:05.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:05.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:05.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:05.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:05.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:05.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:05.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:05.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:07.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:07.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:07.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:07.222 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:08:07.222 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:08:07.222 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:08:07.224 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:08:07.240 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:07.234+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:08:07.245 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:07.238+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:08:07.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:07.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:07.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:07.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:07.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:07.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:07.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:07.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:07.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:07.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:07.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:07.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:07.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:07.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:07.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:07.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:07.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:07.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:07.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:07.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:07.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:07.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:07.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:08.391 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:08.386+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:08:08.391 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:08.386+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:08:08.391 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:08.386+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:08:08.590 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:08:08.591 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:08:08.592 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456488 2023-09-23T08:08:08.592 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456488 -le 1695457101 ]] 2023-09-23T08:08:08.592 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:08:08.592 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:08:08.592 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:08:10.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:10.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:10.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:10.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:10.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:10.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:10.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:10.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:10.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:10.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:10.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:10.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:10.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:10.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:10.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:10.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:10.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:10.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:11.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:11.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:11.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:11.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:11.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:11.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:11.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:11.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:11.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:11.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:11.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:11.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:11.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:12.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:12.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:12.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:12.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:12.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:12.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:12.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:12.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:12.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:12.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:12.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:12.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:12.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:12.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:12.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:12.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:12.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:12.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:12.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:12.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:12.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:12.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:12.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:12.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:12.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:12.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:12.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:12.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:12.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:12.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:12.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:12.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:12.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:12.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:14.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:14.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:14.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:14.506 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:14.498+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:08:14.507 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:14.498+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:08:14.515 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:14.510+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:08:14.515 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:14.510+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:08:14.515 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:14.510+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:08:14.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:14.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:14.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:14.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:14.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:14.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:14.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:14.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:14.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:14.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:14.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:17.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:17.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:17.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:17.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:17.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:17.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:17.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:17.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:17.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:17.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:17.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:17.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:17.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:17.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:17.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:17.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:17.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:18.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:18.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:18.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:18.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:18.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:18.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:18.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:18.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:18.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:18.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:18.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:18.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:18.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:18.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:18.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:18.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:18.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:18.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:18.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:18.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:18.601 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:08:18.601 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:08:18.602 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:08:18.613 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:08:19.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:19.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:19.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:19.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:19.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:19.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:19.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:19.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:19.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:19.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:19.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:19.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:20.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:20.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:20.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:20.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:20.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:20.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:20.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:20.286 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:08:20.287 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:08:20.289 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456500 2023-09-23T08:08:20.289 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456500 -le 1695457101 ]] 2023-09-23T08:08:20.289 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:08:20.289 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:08:20.289 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:08:20.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:20.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:20.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:20.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:20.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:20.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:20.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:20.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:20.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:20.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:23.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:23.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:23.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:23.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:23.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:23.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:23.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:23.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:23.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:23.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:23.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:23.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:23.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:23.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:23.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:23.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:26.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:26.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:26.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:26.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:26.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:26.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:26.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:26.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:26.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:26.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:26.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:26.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:27.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:27.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:27.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:27.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:27.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:27.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:27.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:27.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:27.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:27.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:27.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:27.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:27.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:27.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:27.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:27.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:27.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:27.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:27.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:27.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:27.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:27.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:27.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:27.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:27.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:27.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:27.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:27.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:27.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:27.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:28.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:28.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:28.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:28.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:28.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:28.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:28.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:28.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:28.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:28.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:28.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:28.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:28.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:28.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:28.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:28.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:28.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:28.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:28.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:28.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:30.293 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:08:30.296 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:08:30.301 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:08:30.306 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:08:31.550 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:08:31.550 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:08:31.558 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456511 2023-09-23T08:08:31.558 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456511 -le 1695457101 ]] 2023-09-23T08:08:31.558 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:08:31.558 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:08:31.558 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:08:32.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:32.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:32.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:32.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:32.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:32.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:32.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:32.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:32.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:32.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:32.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:32.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:32.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:32.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:33.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:32.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:33.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:33.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:33.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:33.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:33.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:33.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:35.246 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:35.242+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:08:37.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:37.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:37.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:37.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:37.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:37.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:37.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:37.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:37.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:37.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:37.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:37.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:37.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:37.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:37.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:37.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:37.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:37.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:37.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:37.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:37.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:37.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:38.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:38.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:38.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:38.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:38.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:38.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:38.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:38.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:38.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:38.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:38.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:38.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:39.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:38.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:39.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:38.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:39.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:38.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:39.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:39.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:39.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:39.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:39.418 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:39.413+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:08:39.418 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:39.413+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:08:41.563 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:08:41.563 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:08:41.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:41.568 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:08:41.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:41.596 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:08:41.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:41.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:41.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:41.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:41.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:41.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:41.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:41.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:41.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:41.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:42.979 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:08:42.981 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:08:42.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456522 2023-09-23T08:08:42.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456522 -le 1695457101 ]] 2023-09-23T08:08:42.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:08:42.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:08:42.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:08:43.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:43.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:43.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:43.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:43.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:43.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:43.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:43.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:43.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:43.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:43.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:43.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:44.522 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:44.517+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:08:44.522 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:44.517+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:08:44.522 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:44.517+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:08:44.522 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:44.517+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:08:44.522 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:08:44.517+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:08:44.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:44.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:44.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:44.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:44.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:44.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:44.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:44.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:44.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:44.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:44.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:44.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:44.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:44.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:46.644 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:08:46.633+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:08:48.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:48.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:48.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:48.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:48.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:48.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:48.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:48.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:48.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:48.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:48.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:48.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:48.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:48.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:48.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:48.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:48.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:48.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:48.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:48.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:50.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:50.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:50.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:50.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:50.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:50.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:50.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:50.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:50.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:50.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:50.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:50.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:50.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:50.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:50.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:50.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:50.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:50.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:51.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:51.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:51.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:51.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:51.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:51.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:51.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:51.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:51.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:51.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:51.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:51.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:51.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:51.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:51.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:51.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:51.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:51.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:52.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:52.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:52.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:52.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:52.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:52.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:52.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:52.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:52.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:52.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:52.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:52.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:52.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:52.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:52.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:52.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:52.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:52.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:52.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:52.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:52.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:52.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:52.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:52.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:52.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:53.005 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:08:53.007 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:08:53.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:53.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:53.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:53.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:53.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:53.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:53.027 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:08:53.028 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:08:53.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:53.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:53.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:53.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:53.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:53.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:53.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:53.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:53.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:53.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:53.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:53.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:54.190 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:08:54.190 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:08:54.191 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456534 2023-09-23T08:08:54.191 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456534 -le 1695457101 ]] 2023-09-23T08:08:54.191 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:08:54.191 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:08:54.191 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:08:54.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:08:54.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:54.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:54.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:54.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:54.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:54.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:54.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:54.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:54.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:54.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:54.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:54.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:55.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:08:55.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:55.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:55.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:55.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:55.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:55.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:55.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:55.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:55.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:55.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:55.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:55.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:55.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:55.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:55.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:55.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:55.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:55.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:55.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:55.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:56.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:56.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:56.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:56.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:56.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:56.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:08:56.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:56.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:56.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:56.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:56.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:56.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:56.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:56.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:56.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:56.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:56.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:56.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:56.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:56.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:08:57.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:57.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:08:57.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:57.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:08:57.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:57.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:08:57.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:57.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:08:57.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:57.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:08:57.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:57.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:08:57.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:57.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:08:57.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:57.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:08:57.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:08:57.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:00.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:00.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:00.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:00.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:00.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:00.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:00.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:00.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:00.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:00.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:00.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:00.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:00.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:00.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:03.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:03.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:03.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:03.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:03.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:03.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:03.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:03.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:03.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:03.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:03.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:03.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:03.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:03.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:03.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:03.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:03.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:03.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:03.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:03.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:04.203 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:09:04.205 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:09:04.209 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:09:04.226 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:09:05.604 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:09:05.604 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:09:05.605 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456545 2023-09-23T08:09:05.605 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456545 -le 1695457101 ]] 2023-09-23T08:09:05.605 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:09:05.605 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:09:05.605 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:09:07.565 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:07.561+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:09:07.565 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:07.561+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:09:08.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:08.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:09:08.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:08.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:08.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:08.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:08.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:08.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:08.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:08.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:08.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:08.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:08.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:08.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:08.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:08.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:08.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:08.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:08.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:08.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:09.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:09.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:09.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:09.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:09.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:09.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:09.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:09.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:09.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:09.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:09.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:09.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:09.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:09.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:09.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:09.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:10.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:09:10.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:10.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:10.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:10.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:10.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:10.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:10.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:10.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:10.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:10.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:10.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:10.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:12.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:12.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:12.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:12.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:12.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:12.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:12.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:12.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:12.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:12.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:12.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:12.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:12.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:12.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:13.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:13.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:13.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:13.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:13.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:13.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:13.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:13.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:13.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:13.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:13.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:13.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:13.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:13.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:13.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:13.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:13.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:13.376 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:13.373+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:09:13.376 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:13.373+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:09:13.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:13.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:13.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:13.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:13.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:13.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:13.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:13.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:13.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:13.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:13.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:13.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:09:13.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:13.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:13.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:13.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:13.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:13.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:13.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:13.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:13.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:13.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:13.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:13.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:14.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:14.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:14.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:14.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:14.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:14.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:14.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:14.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:14.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:14.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:14.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:14.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:15.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:15.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:15.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:15.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:15.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:15.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:15.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:09:15.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:15.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:15.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:15.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:15.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:15.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:15.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:15.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:15.617 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:09:15.619 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:09:15.619 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:09:15.619 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:09:16.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:16.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:16.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:16.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:16.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:16.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:16.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:16.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:16.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:16.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:16.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:16.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:16.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:16.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:16.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:16.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:16.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:16.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:16.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:16.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:16.913 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:09:16.913 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:09:16.914 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456556 2023-09-23T08:09:16.915 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456556 -le 1695457101 ]] 2023-09-23T08:09:16.915 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:09:16.915 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:09:16.915 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:09:17.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:17.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:17.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:17.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:17.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:17.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:17.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:17.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:17.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:17.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:17.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:17.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:17.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:17.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:17.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:17.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:17.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:17.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:17.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:17.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:18.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:18.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:18.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:18.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:18.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:18.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:18.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:18.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:18.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:18.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:18.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:18.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:19.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:09:19.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:19.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:19.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:19.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:19.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:19.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:19.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:19.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:19.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:19.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:19.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:19.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:09:19.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:19.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:19.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:19.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:19.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:19.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:19.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:19.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:19.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:19.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:19.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:19.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:19.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:19.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:19.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:19.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:19.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:20.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:20.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:20.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:20.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:20.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:20.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:20.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:20.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:20.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:20.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:20.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:20.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:20.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:20.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:20.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:20.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:21.758 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:21.753+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:09:21.758 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:21.753+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:09:21.787 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:21.785+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:09:21.787 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:21.785+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:09:21.787 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:21.785+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:09:21.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:21.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:21.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:21.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:21.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:21.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:22.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:22.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:22.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:22.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:22.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:22.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:22.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:22.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:22.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:09:22.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:22.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:22.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:22.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:22.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:22.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:22.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:22.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:22.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:22.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:22.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:25.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:25.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:25.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:25.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:25.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:25.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:25.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:25.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:25.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:25.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:25.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:25.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:25.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:25.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:25.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:25.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:25.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:25.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:25.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:25.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:25.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:25.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:25.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:25.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:25.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:25.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:26.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:26.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:26.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:26.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:26.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:26.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:26.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:26.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:26.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:26.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:26.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:26.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:26.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:26.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:26.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:26.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:26.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:26.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:26.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:26.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:26.916 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:09:26.923 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:09:26.923 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:09:26.934 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:09:27.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:27.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:27.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:27.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:27.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:27.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:27.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:27.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:27.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:27.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:27.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:27.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:27.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:27.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:27.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:27.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:27.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:27.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:28.034 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:28.033+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:09:28.035 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:28.033+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:09:28.035 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:28.033+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:09:28.417 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:09:28.418 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:09:28.419 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456568 2023-09-23T08:09:28.419 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456568 -le 1695457101 ]] 2023-09-23T08:09:28.419 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:09:28.420 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:09:28.420 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:09:31.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:31.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:31.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:31.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:31.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:31.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:31.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:31.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:31.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:31.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:31.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:31.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:31.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:31.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:31.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:31.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:31.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:31.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:32.956 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:32.953+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:09:33.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:33.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:33.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:33.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:33.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:33.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:33.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:33.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:33.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:33.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:33.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:33.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:33.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:33.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:33.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:33.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:33.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:33.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:33.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:33.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:36.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:09:36.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:36.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:36.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:36.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:36.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:36.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:36.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:36.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:36.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:36.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:36.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:36.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:38.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:38.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:38.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:38.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:38.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:38.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:38.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:38.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:38.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:38.426 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:09:38.426 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:09:38.427 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:09:38.451 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:09:38.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:38.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:38.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:39.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:39.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:39.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:39.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:39.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:39.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:39.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:39.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:39.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:39.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:39.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:39.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:39.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:39.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:39.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:39.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:39.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:39.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:39.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:39.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:39.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:39.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:39.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:39.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:39.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:39.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:39.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:40.083 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:09:40.083 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:09:40.084 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456580 2023-09-23T08:09:40.084 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456580 -le 1695457101 ]] 2023-09-23T08:09:40.084 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:09:40.084 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:09:40.084 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:09:40.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:40.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:40.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:40.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:40.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:40.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:40.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:40.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:40.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:40.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:40.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:40.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:40.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:40.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:40.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:40.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:40.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:40.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:40.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:40.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:42.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:42.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:42.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:42.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:42.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:42.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:42.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:42.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:42.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:42.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:42.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:42.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:42.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:42.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:42.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:42.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:42.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:42.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:42.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:44.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:44.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:44.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:44.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:44.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:44.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:44.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:44.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:44.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:44.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:44.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:44.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:44.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:44.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:44.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:44.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:44.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:44.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:44.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:44.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:48.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:48.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:48.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:48.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:48.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:48.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:48.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:48.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:48.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:48.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:48.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:48.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:48.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:48.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:49.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:49.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:49.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:49.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:49.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:49.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:49.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:49.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:49.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:49.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:49.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:49.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:49.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:49.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:49.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:49.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:49.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:49.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:50.110 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:09:50.111 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:09:50.135 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:09:50.146 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:09:50.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:50.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:50.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:50.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:50.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:50.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:50.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:50.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:50.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:50.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:50.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:50.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:50.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:50.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:50.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:50.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:51.673 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:09:51.673 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:09:51.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456591 2023-09-23T08:09:51.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456591 -le 1695457101 ]] 2023-09-23T08:09:51.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:09:51.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:09:51.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:09:52.216 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:52.212+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:09:52.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:52.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:52.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:52.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:52.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:52.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:52.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:52.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:52.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:52.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:52.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:52.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:52.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:52.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:52.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:52.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:52.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:52.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:52.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:52.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:54.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:54.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:54.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:54.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:54.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:54.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:54.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:54.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:54.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:54.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:54.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:54.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:55.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:55.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:55.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:55.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:55.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:55.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:55.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:55.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:55.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:55.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:55.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:55.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:55.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:55.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:55.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:55.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:55.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:55.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:56.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:56.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:56.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:56.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:56.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:56.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:56.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:56.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:56.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:56.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:56.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:56.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:56.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:56.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:56.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:57.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:57.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:57.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:57.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:57.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:57.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:57.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:57.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:57.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:57.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:57.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:57.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:57.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:57.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:57.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:57.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:57.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:57.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:58.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:58.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:58.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:58.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:58.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:58.798 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:09:58.792+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:09:58.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:58.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:58.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:58.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:58.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:58.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:58.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:59.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:59.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:59.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:59.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:09:59.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:09:59.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:09:59.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:09:59.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:09:59.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:09:59.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:09:59.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:09:59.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:09:59.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:09:59.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:09:59.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:09:59.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:09:59.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:01.197 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:10:01.192+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:10:01.197 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:10:01.192+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:10:01.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:01.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:10:01.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:01.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:01.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:01.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:01.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:01.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:01.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:01.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:01.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:01.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:01.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:01.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:01.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:01.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:01.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:01.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:01.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:01.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:01.683 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:10:01.688 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:10:01.690 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:10:01.693 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:10:02.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:02.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:02.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:02.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:02.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:02.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:02.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:02.929 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:10:02.929 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:10:02.933 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456602 2023-09-23T08:10:02.933 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456602 -le 1695457101 ]] 2023-09-23T08:10:02.933 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:10:02.933 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:10:02.933 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:10:02.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:02.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:02.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:02.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:02.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:02.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:03.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:03.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:03.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:10:03.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:03.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:03.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:03.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:03.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:03.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:03.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:03.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:03.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:03.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:03.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:03.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:04.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:04.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:04.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:04.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:04.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:04.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:04.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:04.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:04.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:04.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:04.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:04.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:04.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:04.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:04.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:04.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:04.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:04.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:04.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:04.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:10:04.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:04.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:04.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:04.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:04.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:04.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:04.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:04.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:04.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:04.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:04.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:04.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:04.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:04.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:04.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:04.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:04.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:04.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:04.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:04.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:04.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:04.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:04.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:05.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:10:05.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:05.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:05.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:05.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:05.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:05.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:05.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:05.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:05.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:05.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:05.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:05.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:05.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:09.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:09.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:10:09.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:09.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:09.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:09.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:09.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:09.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:09.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:09.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:09.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:09.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:10.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:10.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:10.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:10.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:10.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:10.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:10.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:10.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:10.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:10.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:10.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:10.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:10.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:10.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:10.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:10.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:10.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:11.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:11.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:11.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:11.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:11.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:11.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:11.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:11.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:11.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:11.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:11.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:11.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:11.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:11.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:11.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:11.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:11.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:11.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:12.935 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:10:12.946 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:10:12.947 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:10:12.975 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:10:14.455 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:10:14.456 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:10:14.456 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456614 2023-09-23T08:10:14.456 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456614 -le 1695457101 ]] 2023-09-23T08:10:14.457 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:10:14.457 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:10:14.457 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:10:16.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:16.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:16.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:16.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:16.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:16.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:16.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:16.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:16.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:16.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:16.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:16.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:16.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:16.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:16.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:16.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:16.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:16.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:17.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:17.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:17.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:17.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:17.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:17.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:17.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:17.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:17.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:17.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:17.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:17.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:17.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:17.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:17.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:17.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:17.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:17.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:17.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:17.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:18.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:18.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:18.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:18.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:18.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:18.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:18.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:18.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:18.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:18.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:18.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:18.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:18.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:18.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:18.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:18.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:18.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:18.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:18.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:18.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:18.943 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:10:18.940+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:10:19.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:19.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:19.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:19.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:19.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:19.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:19.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:19.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:19.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:19.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:19.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:19.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:19.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:19.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:19.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:19.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:21.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:21.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:21.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:21.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:21.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:21.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:21.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:21.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:21.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:21.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:21.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:21.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:21.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:21.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:22.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:22.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:22.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:22.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:22.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:22.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:22.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:22.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:22.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:22.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:22.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:22.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:22.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:22.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:22.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:22.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:22.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:22.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:22.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:22.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:23.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:23.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:23.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:23.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:23.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:23.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:23.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:23.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:23.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:23.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:23.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:23.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:23.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:23.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:23.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:23.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:23.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:23.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:24.462 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:10:24.468 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:10:24.468 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:10:24.478 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:10:25.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:25.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:25.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:25.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:25.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:25.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:25.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:25.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:25.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:25.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:25.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:25.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:25.902 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:10:25.904 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:10:25.905 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456625 2023-09-23T08:10:25.905 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456625 -le 1695457101 ]] 2023-09-23T08:10:25.905 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:10:25.905 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:10:25.905 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:10:26.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:26.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:26.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:26.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:26.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:26.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:26.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:26.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:26.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:26.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:26.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:26.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:26.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:26.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:26.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:26.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:26.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:26.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:26.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:26.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:27.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:27.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:27.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:27.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:27.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:27.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:27.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:27.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:27.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:27.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:27.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:27.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:27.826 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:27.820+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:10:27.826 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:27.820+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:10:27.826 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:27.820+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:10:28.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:28.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:28.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:28.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:28.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:28.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:28.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:28.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:28.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:28.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:28.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:28.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:28.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:28.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:29.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:28.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:29.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:29.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:29.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:29.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:29.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:29.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:29.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:29.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:29.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:29.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:29.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:29.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:29.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:29.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:29.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:32.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:32.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:32.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:32.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:32.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:32.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:32.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:32.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:32.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:32.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:32.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:32.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:32.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:32.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:34.031 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:34.028+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:10:34.031 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:34.028+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:10:35.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:35.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:35.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:35.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:35.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:35.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:35.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:35.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:35.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:35.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:35.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:35.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:35.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:35.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:35.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:35.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:35.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:35.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:35.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:35.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:35.911 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:10:35.912 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:10:35.912 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:10:35.963 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:10:37.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:37.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:37.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:37.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:37.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:37.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:37.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:37.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:37.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:37.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:37.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:37.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:37.416 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:10:37.416 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:10:37.417 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456637 2023-09-23T08:10:37.417 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456637 -le 1695457101 ]] 2023-09-23T08:10:37.417 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:10:37.417 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:10:37.418 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:10:37.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:37.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:37.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:37.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:37.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:37.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:37.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:37.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:37.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:37.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:37.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:37.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:37.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:37.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:37.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:37.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:38.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:38.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:38.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:38.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:38.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:38.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:38.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:38.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:38.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:38.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:38.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:38.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:38.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:38.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:38.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:38.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:38.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:38.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:38.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:38.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:40.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:40.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:40.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:40.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:40.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:40.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:40.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:40.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:40.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:40.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:40.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:40.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:40.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:40.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:40.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:40.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:40.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:40.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:40.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:41.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:41.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:41.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:41.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:41.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:41.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:41.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:41.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:41.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:41.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:41.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:41.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:43.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:43.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:43.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:43.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:43.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:43.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:43.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:43.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:43.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:43.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:43.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:43.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:43.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:43.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:43.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:43.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:43.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:43.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:43.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:43.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:46.830 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:46.811+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:10:47.420 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:10:47.421 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:10:47.431 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:10:47.439 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:10:48.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:48.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:48.628 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:10:48.630 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:10:48.631 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456648 2023-09-23T08:10:48.631 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456648 -le 1695457101 ]] 2023-09-23T08:10:48.632 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:10:48.632 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:10:48.632 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:10:48.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:48.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:48.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:48.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:48.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:48.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:48.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:48.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:48.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:48.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:49.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:49.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:49.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:49.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:49.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:49.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:49.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:49.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:49.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:49.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:49.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:49.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:49.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:49.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:49.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:49.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:49.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:50.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:50.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:50.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:50.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:50.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:50.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:50.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:50.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:50.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:50.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:50.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:50.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:50.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:50.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:50.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:50.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:51.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:51.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:51.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:51.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:51.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:51.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:51.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:51.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:51.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:10:51.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:51.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:51.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:51.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:51.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:51.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:51.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:51.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:51.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:51.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:51.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:51.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:52.051 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:52.047+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:10:52.906 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:52.899+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:10:52.913 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:52.907+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:10:52.913 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:52.907+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:10:52.914 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:10:52.907+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:10:52.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:52.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:53.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:53.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:53.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:53.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:53.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:53.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:53.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:53.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:53.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:53.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:53.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:53.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:55.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:54.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:55.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:55.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:55.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:55.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:55.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:55.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:55.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:55.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:55.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:55.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:55.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:55.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:55.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:55.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:55.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:55.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:55.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:55.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:55.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:55.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:55.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:56.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:10:56.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:56.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:56.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:56.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:56.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:56.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:56.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:56.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:56.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:56.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:56.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:56.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:56.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:56.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:56.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:56.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:56.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:56.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:56.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:10:56.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:56.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:56.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:56.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:56.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:56.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:56.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:56.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:57.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:57.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:57.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:57.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:57.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:57.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:57.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:57.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:57.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:57.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:57.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:57.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:58.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:58.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:58.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:58.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:58.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:58.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:58.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:58.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:58.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:58.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:58.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:58.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:58.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:58.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:58.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:58.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:58.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:58.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:58.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:58.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:58.659 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:10:58.659 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:10:58.665 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:10:58.680 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:10:59.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:59.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:59.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:59.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:59.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:59.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:59.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:59.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:59.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:59.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:10:59.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:10:59.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:10:59.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:10:59.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:10:59.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:10:59.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:10:59.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:10:59.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:10:59.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:10:59.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:10:59.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:10:59.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:10:59.917 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:10:59.918 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:10:59.919 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456659 2023-09-23T08:10:59.919 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456659 -le 1695457101 ]] 2023-09-23T08:10:59.919 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:10:59.919 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:10:59.919 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:11:01.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:01.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:01.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:01.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:01.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:01.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:01.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:01.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:02.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:01.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:02.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:02.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:02.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:02.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:02.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:02.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:02.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:02.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:02.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:02.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:02.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:02.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:03.040 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:03.027+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:11:03.047 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:03.043+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:11:03.047 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:03.043+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:11:05.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:05.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:05.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:05.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:05.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:05.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:05.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:05.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:05.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:05.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:05.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:05.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:05.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:05.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:05.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:05.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:07.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:07.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:07.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:07.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:07.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:07.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:07.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:07.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:07.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:07.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:07.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:07.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:07.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:07.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:07.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:07.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:07.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:07.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:08.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:08.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:08.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:08.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:08.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:08.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:08.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:08.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:08.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:08.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:08.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:08.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:09.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:09.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:09.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:09.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:09.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:09.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:09.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:09.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:09.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:09.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:09.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:09.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:09.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:09.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:09.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:09.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:09.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:09.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:09.921 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:11:09.922 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:11:09.928 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:11:09.954 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:11:11.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:11.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:11.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:11.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:11.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:11.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:11.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:11.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:11.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:11.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:11.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:11.303 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:11:11.309 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:11:11.311 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456671 2023-09-23T08:11:11.311 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456671 -le 1695457101 ]] 2023-09-23T08:11:11.311 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:11:11.311 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:11:11.311 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:11:11.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:11.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:11.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:11.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:11.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:11.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:11.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:11.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:11.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:11.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:11.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:11.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:11.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:11.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:11.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:11.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:11.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:11.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:11.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:11.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:11.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:11.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:11.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:11.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:11.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:11.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:11.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:11.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:11.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:11.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:11.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:13.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:13.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:13.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:13.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:13.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:13.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:13.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:13.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:13.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:13.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:13.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:13.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:13.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:13.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:13.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:13.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:14.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:14.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:14.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:14.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:14.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:14.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:14.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:14.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:14.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:14.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:14.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:14.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:14.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:14.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:14.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:14.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:14.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:14.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:14.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:14.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:15.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:15.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:15.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:15.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:15.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:15.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:15.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:15.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:15.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:15.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:15.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:15.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:16.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:16.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:16.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:16.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:16.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:16.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:16.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:16.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:16.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:16.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:16.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:16.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:16.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:16.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:16.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:16.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:16.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:16.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:16.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:16.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:16.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:17.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:17.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:17.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:17.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:17.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:17.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:17.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:17.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:17.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:17.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:17.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:17.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:17.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:17.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:17.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:17.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:17.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:17.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:18.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:18.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:18.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:18.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:18.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:18.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:18.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:18.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:19.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:18.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:19.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:19.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:19.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:19.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:19.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:19.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:19.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:19.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:19.513 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:19.507+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:11:20.808 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:20.803+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:11:20.808 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:20.803+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:11:20.809 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:20.803+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:11:20.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:20.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:20.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:20.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:20.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:20.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:20.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:20.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:20.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:20.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:20.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:20.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:20.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:20.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:21.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:21.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:21.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:21.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:20.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:21.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:21.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:21.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:21.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:21.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:21.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:21.350 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:11:21.350 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:11:21.366 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:11:21.372 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:11:21.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:21.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:21.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:21.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:21.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:21.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:21.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:21.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:21.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:21.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:21.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:21.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:21.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:21.967 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:21.955+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:11:21.967 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:21.955+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:11:22.824 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:11:22.824 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:11:22.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456682 2023-09-23T08:11:22.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456682 -le 1695457101 ]] 2023-09-23T08:11:22.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:11:22.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:11:22.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:11:23.371 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:23.367+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:11:23.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:23.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:23.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:23.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:23.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:23.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:23.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:23.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:23.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:23.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:23.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:23.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:23.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:23.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:23.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:23.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:23.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:23.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:24.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:24.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:24.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:24.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:24.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:24.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:24.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:24.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:24.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:24.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:24.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:24.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:24.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:24.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:24.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:24.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:24.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:24.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:24.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:24.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:24.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:24.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:24.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:24.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:24.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:24.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:24.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:24.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:24.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:25.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:25.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:25.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:25.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:25.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:25.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:25.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:25.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:25.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:25.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:25.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:25.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:25.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:25.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:25.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:25.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:25.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:25.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:25.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:25.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:25.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:25.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:25.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:25.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:25.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:25.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:25.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:25.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:25.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:25.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:25.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:25.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:25.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:25.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:25.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:25.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:25.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:25.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:25.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:25.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:25.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:25.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:25.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:25.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:25.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:25.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:25.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:25.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:26.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:26.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:26.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:26.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:26.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:26.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:26.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:26.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:26.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:26.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:26.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:26.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:26.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:26.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:26.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:26.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:26.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:27.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:27.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:27.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:28.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:28.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:28.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:28.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:28.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:28.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:28.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:28.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:28.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:27.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:29.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:29.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:29.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:29.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:29.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:29.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:29.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:29.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:29.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:29.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:29.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:29.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:29.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:29.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:29.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:29.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:32.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:32.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:32.626 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:32.623+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:11:32.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:32.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:32.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:32.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:32.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:32.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:32.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:32.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:32.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:32.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:32.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:32.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:32.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:32.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:32.651 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:32.643+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:11:32.651 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:32.643+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:11:32.651 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:32.643+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:11:32.840 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:11:32.840 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:11:32.840 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:11:32.875 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:11:34.320 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:11:34.320 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:11:34.321 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456694 2023-09-23T08:11:34.321 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456694 -le 1695457101 ]] 2023-09-23T08:11:34.321 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:11:34.321 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:11:34.321 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:11:34.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:34.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:34.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:34.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:34.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:34.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:34.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:34.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:34.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:34.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:34.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:35.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:35.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:34.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:35.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:35.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:35.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:35.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:35.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:35.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:35.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:35.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:35.786 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:35.779+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:11:35.786 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:35.779+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:11:36.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:36.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:36.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:36.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:36.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:36.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:36.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:36.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:36.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:36.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:36.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:36.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:36.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:36.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:38.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:38.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:38.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:38.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:38.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:38.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:38.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:38.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:38.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:38.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:38.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:38.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:38.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:38.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:38.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:38.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:40.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:40.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:40.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:40.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:40.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:40.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:40.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:40.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:40.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:40.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:40.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:40.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:41.525 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:41.519+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:11:41.525 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:41.519+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:11:42.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:42.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:42.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:42.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:42.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:42.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:42.270 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:42.263+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:11:42.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:42.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:42.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:42.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:42.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:42.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:42.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:44.323 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:11:44.323 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:11:44.324 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:11:44.324 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:11:44.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:44.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:44.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:44.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:44.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:44.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:44.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:44.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:44.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:44.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:44.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:44.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:44.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:44.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:44.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:44.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:44.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:45.087 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:45.083+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:11:45.087 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:45.083+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:11:45.087 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:45.083+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:11:45.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:45.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:45.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:45.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:45.596 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:11:45.607 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:11:45.609 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456705 2023-09-23T08:11:45.609 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456705 -le 1695457101 ]] 2023-09-23T08:11:45.609 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:11:45.609 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:11:45.610 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:11:45.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:45.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:45.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:45.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:45.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:45.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:45.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:45.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:45.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:45.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:45.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:45.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:45.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:45.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:45.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:45.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:45.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:45.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:45.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:45.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:45.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:45.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:45.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:45.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:45.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:46.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:46.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:46.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:46.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:46.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:46.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:46.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:46.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:46.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:46.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:46.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:46.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:46.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:46.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:46.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:46.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:46.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:46.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:47.265 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:47.259+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:11:47.270 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:47.263+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:11:47.270 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:47.263+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:11:48.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:48.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:48.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:48.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:48.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:48.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:48.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:48.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:48.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:48.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:48.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:48.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:48.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:48.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:48.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:48.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:48.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:48.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:50.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:50.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:50.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:50.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:50.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:50.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:50.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:50.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:50.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:50.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:50.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:50.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:50.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:50.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:50.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:50.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:50.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:50.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:50.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:50.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:50.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:50.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:50.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:50.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:50.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:50.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:50.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:53.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:53.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:53.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:53.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:53.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:53.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:53.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:53.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:53.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:53.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:53.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:53.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:53.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:53.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:53.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:53.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:53.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:53.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:53.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:53.990 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:53.982+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:11:53.994 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:53.986+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:11:53.994 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:11:53.986+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:11:54.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:54.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:54.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:54.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:54.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:54.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:54.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:54.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:54.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:54.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:54.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:54.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:54.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:54.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:54.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:54.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:54.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:54.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:54.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:54.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:54.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:54.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:54.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:55.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:55.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:55.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:55.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:55.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:55.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:55.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:55.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:55.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:55.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:55.617 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:11:55.618 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:11:55.618 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:11:55.627 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:11:55.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:55.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:55.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:55.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:55.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:55.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:55.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:56.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:56.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:56.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:56.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:56.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:56.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:56.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:56.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:56.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:56.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:56.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:56.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:57.051 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:11:57.061 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:11:57.072 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456717 2023-09-23T08:11:57.072 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456717 -le 1695457101 ]] 2023-09-23T08:11:57.073 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:11:57.073 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:11:57.073 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:11:57.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:57.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:57.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:57.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:57.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:57.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:57.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:57.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:57.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:57.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:57.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:57.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:11:57.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:11:57.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:57.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:11:58.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:57.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:58.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:58.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:11:58.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:11:58.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:58.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:11:58.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:58.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:11:58.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:11:58.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:11:58.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:11:58.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:11:58.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:11:58.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:11:58.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:00.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:00.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:00.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:00.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:00.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:00.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:00.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:00.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:00.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:00.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:12:00.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:00.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:00.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:00.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:00.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:00.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:00.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:00.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:00.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:00.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:01.105 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:01.098+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:12:01.106 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:01.098+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:12:01.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:01.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:01.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:01.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:01.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:01.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:01.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:01.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:01.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:01.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:01.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:01.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:01.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:01.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:01.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:01.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:01.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:01.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:01.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:01.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:02.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:02.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:02.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:02.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:02.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:02.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:02.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:02.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:02.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:02.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:02.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:02.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:02.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:02.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:02.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:02.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:02.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:02.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:04.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:04.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:04.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:04.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:04.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:04.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:04.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:04.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:04.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:04.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:04.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:04.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:05.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:05.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:05.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:05.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:05.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:05.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:05.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:05.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:05.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:05.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:05.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:05.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:05.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:05.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:06.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:06.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:06.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:06.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:06.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:06.283 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:06.278+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:12:06.283 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:06.278+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:12:06.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:06.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:06.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:06.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:06.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:06.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:06.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:06.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:07.088 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:12:07.092 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:12:07.098 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:12:07.102 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:12:08.475 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:12:08.478 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:12:08.488 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456728 2023-09-23T08:12:08.489 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456728 -le 1695457101 ]] 2023-09-23T08:12:08.489 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:12:08.489 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:12:08.489 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:12:09.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:09.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:09.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:09.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:09.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:09.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:09.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:09.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:09.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:09.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:09.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:09.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:09.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:09.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:09.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:09.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:09.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:09.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:10.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:10.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:10.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:10.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:10.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:10.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:10.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:10.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:10.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:10.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:10.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:10.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:10.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:10.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:10.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:10.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:10.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:10.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:10.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:10.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:10.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:17.356 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:17.346+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:12:17.356 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:17.346+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:12:17.356 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:17.346+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:12:17.513 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:17.506+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:12:17.513 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:17.506+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:12:17.513 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:17.506+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:12:17.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:17.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:17.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:17.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:17.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:17.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:17.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:17.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:17.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:17.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:12:17.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:17.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:17.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:18.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:17.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:18.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:18.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:18.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:18.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:18.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:18.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:18.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:18.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:18.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:18.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:18.502 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:12:18.503 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:12:18.504 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:12:18.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:18.512 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:12:18.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:18.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:18.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:18.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:18.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:18.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:18.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:18.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:18.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:18.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:18.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:18.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:18.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:18.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:18.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:19.917 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:12:19.923 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:12:19.924 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456739 2023-09-23T08:12:19.924 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456739 -le 1695457101 ]] 2023-09-23T08:12:19.924 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:12:19.925 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:12:19.925 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:12:20.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:20.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:20.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:20.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:20.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:20.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:20.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:20.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:20.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:20.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:20.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:20.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:20.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:20.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:20.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:20.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:20.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:20.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:21.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:21.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:21.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:21.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:21.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:21.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:21.793 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:21.786+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:12:21.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:21.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:21.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:21.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:21.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:21.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:21.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:21.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:21.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:21.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:22.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:22.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:22.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:22.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:22.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:22.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:22.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:22.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:22.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:22.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:22.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:22.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:22.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:22.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:22.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:22.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:22.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:22.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:22.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:22.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:22.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:22.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:22.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:23.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:23.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:23.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:23.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:23.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:23.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:23.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:23.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:23.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:23.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:23.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:23.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:23.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:23.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:23.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:23.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:23.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:24.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:24.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:24.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:24.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:24.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:24.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:24.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:24.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:24.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:24.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:24.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:24.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:24.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:24.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:26.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:26.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:26.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:26.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:26.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:26.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:26.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:26.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:26.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:26.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:26.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:26.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:12:26.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:26.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:26.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:26.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:26.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:26.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:26.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:26.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:26.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:26.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:26.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:29.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:29.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:29.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:29.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:29.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:29.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:29.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:29.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:29.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:29.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:29.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:29.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:29.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:29.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:29.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:29.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:29.942 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:12:29.944 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:12:29.947 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:12:29.959 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:12:31.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:31.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:31.465 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:12:31.468 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:12:31.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:31.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:31.471 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456751 2023-09-23T08:12:31.472 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456751 -le 1695457101 ]] 2023-09-23T08:12:31.472 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:12:31.472 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:12:31.472 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:12:31.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:31.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:31.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:31.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:31.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:31.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:31.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:31.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:31.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:31.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:31.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:31.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:32.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:32.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:32.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:32.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:32.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:32.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:32.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:32.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:32.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:32.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:32.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:32.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:33.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:12:33.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:33.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:33.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:33.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:33.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:33.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:33.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:33.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:33.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:33.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:33.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:33.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:33.963 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:33.958+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:12:33.963 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:33.958+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:12:33.963 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:33.958+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:12:34.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:34.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:34.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:34.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:34.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:34.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:34.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:34.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:34.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:34.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:34.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:34.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:34.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:34.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:35.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:35.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:35.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:35.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:35.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:35.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:35.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:35.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:35.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:35.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:35.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:35.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:35.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:35.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:35.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:36.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:36.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:36.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:36.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:36.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:36.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:36.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:36.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:36.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:36.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:36.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:36.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:36.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:36.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:36.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:36.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:36.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:36.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:38.176 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:38.170+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:12:38.176 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:38.170+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:12:38.176 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:38.170+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:12:40.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:40.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:40.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:40.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:40.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:40.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:40.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:40.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:40.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:40.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:40.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:40.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:41.476 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:12:41.477 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:12:41.477 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:12:41.477 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:12:42.582 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:12:42.574+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:12:42.766 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:12:42.766 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:12:42.767 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456762 2023-09-23T08:12:42.767 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456762 -le 1695457101 ]] 2023-09-23T08:12:42.767 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:12:42.767 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:12:42.767 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:12:44.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:44.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:45.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:45.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:45.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:45.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:45.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:45.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:45.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:45.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:45.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:45.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:45.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:45.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:45.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:45.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:45.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:45.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:46.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:46.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:46.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:46.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:46.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:46.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:46.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:46.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:46.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:46.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:46.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:46.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:48.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:48.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:48.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:48.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:48.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:48.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:48.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:48.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:48.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:48.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:48.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:48.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:12:48.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:48.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:48.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:48.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:48.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:48.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:48.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:48.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:48.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:48.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:48.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:48.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:49.183 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:49.178+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:12:50.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:50.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:50.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:50.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:50.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:50.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:50.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:50.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:50.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:50.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:50.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:50.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:50.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:50.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:50.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:50.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:50.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:50.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:51.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:51.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:51.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:51.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:51.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:51.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:51.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:51.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:51.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:51.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:51.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:51.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:52.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:52.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:52.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:52.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:52.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:52.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:52.791 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:12:52.791 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:12:52.796 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:12:52.815 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:12:54.142 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:12:54.142 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:12:54.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456774 2023-09-23T08:12:54.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456774 -le 1695457101 ]] 2023-09-23T08:12:54.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:12:54.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:12:54.144 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:12:54.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:54.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:54.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:54.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:54.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:54.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:54.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:54.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:54.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:12:54.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:12:54.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:54.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:54.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:54.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:55.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:55.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:55.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:55.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:55.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:55.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:56.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:56.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:56.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:56.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:56.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:56.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:56.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:56.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:56.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:56.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:56.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:56.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:56.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:56.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:56.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:56.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:56.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:56.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:56.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:56.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:56.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:56.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:56.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:56.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:12:56.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:56.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:57.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:57.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:57.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:57.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:57.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:57.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:57.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:57.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:57.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:57.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:57.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:57.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:57.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:57.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:57.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:57.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:59.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:59.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:12:59.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:59.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:12:59.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:59.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:12:59.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:59.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:12:59.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:59.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:12:59.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:59.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:12:59.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:59.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:12:59.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:59.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:12:59.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:12:59.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:12:59.569 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:59.566+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:12:59.569 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:12:59.566+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:13:03.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:03.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:03.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:03.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:03.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:03.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:03.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:03.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:03.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:03.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:03.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:03.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:04.145 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:13:04.145 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:13:04.151 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:13:04.153 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:13:04.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:13:04.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:04.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:04.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:04.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:04.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:04.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:04.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:04.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:04.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:04.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:04.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:05.592 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:13:05.592 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:13:05.600 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456785 2023-09-23T08:13:05.600 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456785 -le 1695457101 ]] 2023-09-23T08:13:05.600 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:13:05.600 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:13:05.600 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:13:06.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:06.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:06.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:06.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:06.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:06.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:06.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:06.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:06.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:06.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:06.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:06.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:06.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:06.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:06.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:06.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:06.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:06.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:08.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:13:08.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:08.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:08.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:08.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:08.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:08.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:08.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:08.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:08.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:08.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:08.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:08.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:13:08.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:08.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:08.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:08.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:08.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:08.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:08.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:08.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:08.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:08.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:08.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:08.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:11.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:11.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:11.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:11.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:11.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:11.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:11.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:11.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:11.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:11.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:11.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:11.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:11.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:11.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:11.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:11.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:11.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:11.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:11.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:11.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:11.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:11.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:14.015 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:14.005+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:13:14.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:14.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:14.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:14.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:14.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:14.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:14.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:14.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:14.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:14.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:14.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:14.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:14.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:14.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:14.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:14.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:14.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:14.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:14.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:15.602 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:13:15.612 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:13:15.613 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:13:15.613 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:13:16.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:16.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:16.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:16.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:16.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:16.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:16.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:16.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:16.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:16.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:16.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:16.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:16.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:16.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:16.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:16.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:16.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:16.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:17.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:17.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:17.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:17.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:17.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:17.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:17.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:17.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:17.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:17.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:17.134 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:13:17.136 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:13:17.150 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456797 2023-09-23T08:13:17.150 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456797 -le 1695457101 ]] 2023-09-23T08:13:17.150 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:13:17.150 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:13:17.150 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:13:18.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:18.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:18.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:18.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:18.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:18.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:18.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:18.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:18.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:18.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:18.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:18.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:18.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:19.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:19.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:19.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:19.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:19.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:19.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:19.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:19.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:19.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:19.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:19.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:19.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:19.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:19.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:19.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:19.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:19.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:19.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:19.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:13:19.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:19.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:19.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:19.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:19.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:19.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:19.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:19.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:19.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:19.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:19.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:19.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:13:19.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:19.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:19.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:19.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:19.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:19.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:19.926 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:13:19.925+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:13:19.927 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:13:19.925+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:13:21.744 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:21.741+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:13:21.744 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:21.741+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:13:22.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:22.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:22.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:22.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:22.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:22.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:22.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:22.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:23.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:22.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:23.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:22.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:23.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:23.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:23.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:23.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:23.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:23.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:23.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:23.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:23.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:23.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:23.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:23.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:23.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:23.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:23.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:23.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:23.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:23.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:23.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:23.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:23.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:23.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:23.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:23.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:23.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:23.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:23.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:23.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:23.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:23.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:23.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:23.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:24.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:24.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:24.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:24.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:24.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:24.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:24.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:24.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:24.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:24.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:24.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:25.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:24.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:25.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:25.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:25.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:25.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:25.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:25.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:25.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:25.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:25.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:25.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:25.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:25.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:25.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:25.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:25.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:25.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:25.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:27.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:27.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:27.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:27.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:27.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:27.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:27.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:27.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:27.162 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:13:27.162 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:13:27.176 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:13:27.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:27.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:27.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:27.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:27.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:27.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:27.201 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:13:27.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:27.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:27.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:27.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:28.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:28.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:28.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:28.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:28.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:28.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:28.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:28.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:28.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:13:28.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:28.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:28.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:28.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:28.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:28.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:28.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:28.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:28.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:28.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:28.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:28.433 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:28.429+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:13:28.434 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:28.429+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:13:28.441 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:28.437+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:13:28.442 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:28.437+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:13:28.442 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:28.437+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:13:28.809 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:13:28.809 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:13:28.810 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456808 2023-09-23T08:13:28.810 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456808 -le 1695457101 ]] 2023-09-23T08:13:28.810 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:13:28.810 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:13:28.810 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:13:28.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:28.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:28.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:28.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:28.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:28.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:28.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:28.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:28.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:28.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:28.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:29.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:29.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:29.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:29.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:29.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:29.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:29.158 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:29.153+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:13:29.158 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:29.153+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:13:29.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:29.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:29.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:29.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:29.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:13:29.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:29.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:29.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:29.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:29.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:29.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:29.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:29.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:30.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:30.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:30.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:30.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:30.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:30.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:30.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:30.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:30.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:30.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:30.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:30.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:30.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:30.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:30.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:30.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:30.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:30.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:34.062 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:34.057+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:13:34.063 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:34.057+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:13:34.063 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:34.057+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:13:34.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:34.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:34.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:34.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:34.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:34.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:34.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:34.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:34.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:34.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:35.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:35.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:35.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:35.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:13:35.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:35.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:35.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:35.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:35.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:35.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:35.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:35.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:35.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:35.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:35.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:35.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:35.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:36.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:36.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:36.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:36.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:36.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:36.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:36.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:36.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:36.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:36.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:36.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:36.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:36.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:36.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:36.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:36.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:36.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:36.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:36.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:36.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:37.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:37.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:37.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:37.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:37.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:37.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:37.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:37.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:37.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:37.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:13:37.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:37.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:37.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:37.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:37.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:37.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:37.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:37.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:37.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:37.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:37.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:37.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:37.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:37.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:37.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:37.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:37.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:37.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:37.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:37.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:37.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:38.812 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:13:38.815 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:13:38.820 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:13:38.821 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:13:40.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:40.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:40.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:40.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:40.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:40.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:40.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:40.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:40.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:40.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:40.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:40.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:40.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:40.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:40.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:40.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:40.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:40.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:40.408 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:13:40.409 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:13:40.409 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456820 2023-09-23T08:13:40.409 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456820 -le 1695457101 ]] 2023-09-23T08:13:40.409 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:13:40.410 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:13:40.410 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:13:40.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:40.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:42.424 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:42.421+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:13:42.426 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:42.421+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:13:42.426 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:13:42.421+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:13:43.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:43.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:43.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:43.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:43.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:43.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:43.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:43.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:43.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:43.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:43.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:43.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:43.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:43.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:43.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:43.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:43.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:43.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:46.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:46.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:46.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:46.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:46.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:46.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:46.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:46.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:46.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:46.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:46.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:46.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:46.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:47.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:47.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:47.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:47.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:47.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:47.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:47.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:47.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:47.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:47.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:47.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:47.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:47.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:47.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:47.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:47.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:47.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:47.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:47.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:47.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:47.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:49.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:49.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:49.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:49.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:49.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:49.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:49.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:49.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:49.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:49.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:49.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:49.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:49.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:49.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:13:49.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:49.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:49.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:49.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:49.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:49.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:49.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:49.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:49.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:49.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:49.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:49.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:49.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:49.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:49.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:50.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:50.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:50.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:50.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:50.427 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:13:50.427 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:13:50.434 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:13:50.448 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:13:51.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:51.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:51.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:51.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:51.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:51.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:51.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:51.732 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:13:51.732 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:13:51.745 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456831 2023-09-23T08:13:51.745 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456831 -le 1695457101 ]] 2023-09-23T08:13:51.746 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:13:51.746 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:13:51.746 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:13:51.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:51.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:51.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:51.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:51.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:51.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:51.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:51.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:51.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:51.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:51.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:52.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:52.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:52.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:52.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:52.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:52.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:52.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:52.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:52.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:52.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:52.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:52.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:52.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:52.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:52.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:52.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:52.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:52.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:52.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:52.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:54.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:54.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:54.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:54.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:54.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:54.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:54.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:54.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:54.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:54.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:54.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:54.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:54.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:54.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:55.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:55.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:55.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:55.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:13:55.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:55.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:55.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:55.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:55.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:55.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:55.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:55.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:55.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:55.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:55.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:55.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:55.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:55.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:55.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:55.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:56.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:56.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:13:56.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:56.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:56.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:56.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:56.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:56.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:56.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:56.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:56.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:56.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:56.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:56.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:56.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:56.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:56.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:56.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:56.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:56.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:13:58.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:58.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:13:58.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:58.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:13:58.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:58.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:13:58.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:58.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:13:58.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:58.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:13:58.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:58.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:13:58.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:58.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:13:58.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:58.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:13:58.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:13:58.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:00.014 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:00.013+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:14:00.015 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:00.013+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:14:00.015 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:00.013+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:14:00.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:00.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:00.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:00.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:00.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:00.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:00.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:00.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:00.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:00.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:00.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:00.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:00.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:00.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:00.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:00.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:00.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:00.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:01.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:01.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:01.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:01.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:01.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:01.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:01.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:01.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:01.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:01.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:01.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:01.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:01.749 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:14:01.749 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:14:01.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:14:01.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:14:01.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:01.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:01.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:01.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:01.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:02.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:02.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:02.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:02.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:02.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:02.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:02.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:02.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:02.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:02.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:02.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:02.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:02.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:02.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:02.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:02.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:02.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:02.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:03.257 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:14:03.263 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:14:03.264 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456843 2023-09-23T08:14:03.264 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456843 -le 1695457101 ]] 2023-09-23T08:14:03.264 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:14:03.264 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:14:03.264 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:14:05.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:05.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:05.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:05.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:05.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:05.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:05.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:05.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:05.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:05.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:05.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:05.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:05.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:05.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:05.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:05.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:05.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:05.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:07.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:07.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:07.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:07.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:07.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:07.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:07.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:07.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:07.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:07.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:07.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:07.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:07.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:07.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:07.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:07.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:07.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:07.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:07.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:07.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:07.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:09.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:09.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:09.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:09.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:09.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:09.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:09.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:09.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:09.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:09.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:09.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:09.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:09.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:09.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:09.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:09.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:09.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:10.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:09.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:10.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:10.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:10.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:10.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:10.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:10.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:10.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:10.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:10.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:10.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:10.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:10.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:10.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:10.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:10.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:10.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:11.495 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:11.492+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:14:11.495 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:11.492+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:14:11.495 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:11.492+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:14:12.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:12.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:12.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:12.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:12.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:12.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:12.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:12.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:12.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:12.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:12.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:12.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:12.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:12.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:12.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:13.271 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:14:13.278 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:14:13.282 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:14:13.304 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:14:14.697 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:14:14.705 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:14:14.707 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456854 2023-09-23T08:14:14.707 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456854 -le 1695457101 ]] 2023-09-23T08:14:14.708 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:14:14.708 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:14:14.708 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:14:15.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:15.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:15.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:15.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:15.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:15.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:15.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:15.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:15.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:15.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:15.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:15.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:15.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:15.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:15.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:15.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:15.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:15.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:15.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:15.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:15.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:15.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:15.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:15.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:15.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:15.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:15.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:15.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:15.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:19.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:19.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:19.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:19.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:19.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:19.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:19.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:19.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:19.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:19.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:19.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:19.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:20.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:20.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:20.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:20.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:20.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:20.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:20.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:20.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:20.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:20.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:20.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:20.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:20.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:20.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:20.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:20.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:21.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:21.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:21.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:21.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:21.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:21.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:21.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:21.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:21.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:21.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:21.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:21.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:21.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:21.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:21.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:21.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:21.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:21.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:23.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:23.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:23.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:23.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:23.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:23.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:23.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:23.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:23.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:23.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:23.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:23.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:23.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:23.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:23.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:23.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:23.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:23.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:23.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:23.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:24.726 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:14:24.726 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:14:24.726 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:14:24.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:14:24.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:24.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:24.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:24.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:24.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:24.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:24.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:24.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:24.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:24.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:24.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:24.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:24.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:24.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:24.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:24.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:26.207 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:14:26.209 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:14:26.210 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456866 2023-09-23T08:14:26.210 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456866 -le 1695457101 ]] 2023-09-23T08:14:26.210 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:14:26.210 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:14:26.210 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:14:26.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:26.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:26.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:26.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:26.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:26.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:26.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:26.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:26.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:26.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:26.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:26.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:26.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:26.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:26.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:26.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:26.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:26.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:26.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:26.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:26.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:26.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:27.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:27.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:27.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:27.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:27.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:27.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:27.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:27.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:27.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:27.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:27.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:27.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:27.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:27.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:27.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:27.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:31.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:31.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:31.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:31.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:31.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:31.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:31.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:31.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:31.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:31.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:33.604 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:14:33.600+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:14:33.622 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:14:33.616+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:14:34.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:34.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:34.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:34.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:34.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:34.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:34.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:34.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:34.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:34.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:34.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:34.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:34.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:34.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:34.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:34.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:34.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:34.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:34.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:34.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:35.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:35.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:35.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:35.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:35.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:35.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:35.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:35.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:35.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:35.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:35.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:14:35.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:35.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:35.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:35.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:35.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:35.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:35.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:35.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:35.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:14:35.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:35.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:35.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:35.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:35.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:35.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:35.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:35.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:35.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:35.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:35.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:35.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:14:35.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:35.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:35.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:36.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:36.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:36.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:36.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:36.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:36.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:36.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:14:36.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:36.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:36.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:36.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:36.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:36.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:36.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:36.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:36.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:36.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:36.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:36.221 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:14:36.221 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:14:36.226 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:14:36.230 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:14:36.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:36.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:36.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:36.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:36.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:36.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:36.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:36.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:36.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:36.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:36.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:36.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:36.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:37.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:37.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:37.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:37.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:37.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:37.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:37.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:37.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:37.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:37.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:37.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:37.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:37.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:37.760 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:14:37.761 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:14:37.762 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456877 2023-09-23T08:14:37.762 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456877 -le 1695457101 ]] 2023-09-23T08:14:37.762 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:14:37.762 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:14:37.762 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:14:37.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:37.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:37.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:37.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:37.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:37.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:37.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:37.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:37.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:37.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:37.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:37.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:37.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:37.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:38.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:38.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:38.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:38.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:38.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:38.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:38.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:38.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:38.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:38.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:38.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:38.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:38.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:38.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:38.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:38.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:40.396 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:40.392+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:14:40.396 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:40.392+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:14:41.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:41.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:41.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:41.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:41.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:41.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:41.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:41.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:41.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:41.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:41.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:41.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:41.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:41.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:41.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:41.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:41.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:41.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:42.590 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:42.584+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:14:42.590 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:42.584+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:14:42.590 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:42.584+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:14:43.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:43.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:43.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:43.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:43.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:43.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:43.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:43.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:43.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:43.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:43.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:43.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:43.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:43.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:47.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:47.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:47.779 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:14:47.779 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:14:47.788 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:14:47.799 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:14:47.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:47.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:47.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:47.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:47.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:47.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:47.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:47.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:47.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:47.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:47.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:47.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:47.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:47.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:47.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:47.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:47.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:47.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:48.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:48.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:48.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:48.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:48.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:48.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:48.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:48.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:48.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:48.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:48.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:48.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:48.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:48.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:48.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:48.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:48.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:48.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:48.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:48.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:48.981 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:14:48.981 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:14:48.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456888 2023-09-23T08:14:48.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456888 -le 1695457101 ]] 2023-09-23T08:14:48.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:14:48.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:14:48.982 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:14:49.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:49.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:49.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:49.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:49.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:49.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:49.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:49.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:49.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:49.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:49.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:49.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:49.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:49.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:49.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:49.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:49.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:49.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:49.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:49.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:49.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:49.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:49.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:49.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:49.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:49.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:50.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:50.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:50.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:50.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:50.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:50.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:50.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:50.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:50.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:50.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:50.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:50.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:50.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:50.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:50.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:50.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:50.528 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:50.524+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:14:50.544 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:50.540+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:14:51.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:51.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:51.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:51.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:51.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:51.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:51.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:51.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:51.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:51.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:51.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:51.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:51.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:51.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:51.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:51.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:51.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:51.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:51.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:51.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:53.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:53.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:53.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:53.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:53.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:53.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:53.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:53.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:53.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:53.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:53.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:53.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:54.666 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:14:54.660+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:14:55.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:55.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:55.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:55.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:55.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:55.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:55.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:55.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:55.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:55.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:55.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:55.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:55.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:55.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:55.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:55.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:55.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:55.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:55.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:55.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:56.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:56.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:56.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:56.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:56.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:56.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:56.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:56.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:56.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:56.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:56.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:56.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:56.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:56.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:56.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:56.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:56.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:56.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:56.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:56.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:57.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:14:57.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:57.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:57.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:57.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:57.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:57.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:57.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:57.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:57.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:57.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:57.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:57.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:14:57.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:57.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:57.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:14:57.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:14:57.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:57.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:14:57.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:57.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:57.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:57.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:57.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:57.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:58.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:58.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:58.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:58.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:14:58.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:58.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:14:58.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:58.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:14:58.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:58.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:14:58.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:58.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:14:58.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:58.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:14:58.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:58.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:14:58.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:14:58.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:14:59.011 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:14:59.011 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:14:59.020 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:14:59.029 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:15:00.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:00.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:00.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:00.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:00.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:00.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:00.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:00.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:00.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:00.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:00.354 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:15:00.355 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:15:00.355 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456900 2023-09-23T08:15:00.355 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456900 -le 1695457101 ]] 2023-09-23T08:15:00.355 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:15:00.355 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:15:00.357 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:15:00.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:00.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:01.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:01.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:01.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:01.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:01.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:01.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:01.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:01.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:01.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:01.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:01.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:01.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:01.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:01.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:01.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:01.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:01.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:01.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:05.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:05.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:05.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:05.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:05.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:06.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:06.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:06.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:06.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:06.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:06.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:06.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:06.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:06.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:06.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:06.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:06.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:06.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:06.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:07.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:07.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:07.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:07.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:07.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:07.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:07.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:07.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:07.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:07.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:07.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:07.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:07.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:07.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:07.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:07.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:08.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:08.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:08.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:08.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:08.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:08.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:08.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:08.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:08.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:08.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:08.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:08.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:08.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:08.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:08.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:08.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:08.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:08.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:09.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:09.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:09.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:09.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:09.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:09.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:09.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:09.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:09.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:09.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:09.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:09.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:10.367 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:15:10.371 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:15:10.371 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:15:10.374 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:15:11.474 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:15:11.472+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:15:11.486 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:15:11.480+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:15:11.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:11.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:11.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:11.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:11.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:11.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:11.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:11.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:11.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:11.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:11.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:11.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:11.682 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:15:11.684 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:15:11.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456911 2023-09-23T08:15:11.691 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456911 -le 1695457101 ]] 2023-09-23T08:15:11.692 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:15:11.692 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:15:11.692 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:15:13.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:13.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:13.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:13.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:13.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:13.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:13.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:13.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:13.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:13.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:13.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:13.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:13.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:13.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:13.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:13.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:14.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:14.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:14.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:14.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:14.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:14.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:14.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:14.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:14.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:14.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:14.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:14.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:14.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:14.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:14.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:14.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:15.157 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:15:15.152+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:15:15.157 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:15:15.152+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:15:17.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:17.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:17.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:17.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:17.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:17.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:17.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:17.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:17.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:17.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:17.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:17.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:17.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:17.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:17.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:17.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:19.110 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:15:19.103+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:15:19.110 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:15:19.103+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:15:19.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:19.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:19.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:19.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:19.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:19.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:19.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:19.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:19.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:19.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:19.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:19.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:19.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:19.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:19.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:19.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:19.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:19.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:19.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:19.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:20.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:20.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:20.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:20.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:20.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:20.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:20.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:20.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:20.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:20.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:20.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:20.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:20.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:20.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:20.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:20.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:20.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:20.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:21.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:21.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:21.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:21.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:21.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:21.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:21.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:21.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:21.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:21.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:21.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:21.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:21.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:21.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:21.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:21.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:21.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:21.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:21.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:21.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:21.702 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:15:21.702 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:15:21.702 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:15:21.716 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:15:21.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:21.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:21.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:21.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:21.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:21.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:21.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:21.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:21.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:21.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:21.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:21.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:21.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:21.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:21.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:21.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:21.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:22.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:22.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:22.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:22.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:22.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:22.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:22.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:22.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:22.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:22.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:22.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:22.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:22.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:22.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:22.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:22.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:23.275 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:15:23.281 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:15:23.282 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456923 2023-09-23T08:15:23.282 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456923 -le 1695457101 ]] 2023-09-23T08:15:23.282 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:15:23.282 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:15:23.283 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:15:24.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:24.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:24.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:24.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:24.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:24.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:24.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:24.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:24.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:24.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:24.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:24.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:24.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:24.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:24.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:24.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:24.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:24.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:24.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:24.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:26.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:26.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:26.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:26.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:26.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:26.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:26.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:26.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:26.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:15:26.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:26.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:26.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:26.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:26.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:26.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:26.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:26.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:26.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:28.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:28.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:28.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:28.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:28.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:28.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:28.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:28.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:28.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:28.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:28.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:28.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:28.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:28.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:29.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:29.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:29.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:29.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:29.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:29.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:29.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:29.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:29.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:29.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:29.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:29.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:29.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:29.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:29.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:29.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:29.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:29.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:29.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:29.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:30.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:30.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:30.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:30.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:30.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:30.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:30.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:30.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:30.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:30.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:30.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:30.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:30.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:30.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:30.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:30.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:30.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:30.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:31.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:31.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:31.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:31.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:31.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:31.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:31.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:31.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:31.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:31.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:31.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:31.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:31.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:31.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:32.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:32.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:32.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:32.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:32.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:32.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:32.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:32.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:32.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:15:32.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:32.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:32.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:32.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:32.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:32.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:32.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:32.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:32.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:32.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:32.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:32.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:32.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:32.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:32.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:32.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:32.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:32.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:32.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:32.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:32.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:32.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:32.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:33.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:33.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:33.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:33.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:33.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:33.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:33.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:33.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:33.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:33.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:33.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:33.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:33.316 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:15:33.316 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:15:33.330 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:15:33.349 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:15:34.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:34.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:34.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:34.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:34.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:34.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:34.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:34.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:34.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:34.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:34.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:34.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:34.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:34.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:34.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:34.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:34.499 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:15:34.500 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:15:34.507 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456934 2023-09-23T08:15:34.507 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456934 -le 1695457101 ]] 2023-09-23T08:15:34.507 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:15:34.507 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:15:34.508 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:15:35.655 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:15:35.647+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:15:35.721 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:15:35.715+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:15:35.721 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:15:35.715+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:15:40.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:40.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:40.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:40.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:40.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:40.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:40.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:40.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:40.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:40.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:40.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:40.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:40.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:40.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:40.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:40.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:40.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:40.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:40.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:40.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:40.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:40.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:41.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:41.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:41.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:41.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:41.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:41.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:41.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:41.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:41.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:41.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:41.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:41.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:41.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:41.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:41.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:41.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:42.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:42.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:42.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:42.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:42.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:42.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:42.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:42.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:42.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:42.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:42.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:42.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:44.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:44.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:44.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:44.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:44.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:44.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:44.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:44.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:44.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:44.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:44.515 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:15:44.517 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:15:44.527 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:15:44.532 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:15:44.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:44.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:44.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:44.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:44.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:44.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:44.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:45.942 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:15:45.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:15:45.943 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456945 2023-09-23T08:15:45.943 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456945 -le 1695457101 ]] 2023-09-23T08:15:45.943 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:15:45.943 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:15:45.943 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:15:46.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:46.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:46.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:46.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:46.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:46.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:46.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:46.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:46.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:46.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:49.027 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:15:49.019+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:15:49.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:49.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:49.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:49.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:49.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:49.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:49.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:49.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:49.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:49.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:49.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:49.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:49.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:49.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:49.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:49.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:49.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:49.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:50.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:50.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:50.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:50.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:50.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:50.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:50.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:50.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:50.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:50.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:50.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:50.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:50.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:50.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:50.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:50.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:50.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:50.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:50.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:50.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:51.306 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:15:51.299+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:15:51.306 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:15:51.299+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:15:51.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:51.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:51.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:51.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:51.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:51.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:51.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:51.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:51.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:51.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:51.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:51.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:51.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:51.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:51.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:51.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:51.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:51.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:51.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:51.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:51.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:52.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:52.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:52.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:52.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:52.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:52.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:52.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:52.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:52.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:52.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:52.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:52.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:52.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:53.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:52.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:53.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:53.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:54.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:54.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:54.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:54.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:54.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:54.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:54.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:54.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:54.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:54.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:54.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:54.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:54.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:54.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:54.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:54.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:55.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:55.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:55.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:55.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:55.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:55.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:55.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:55.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:55.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:55.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:55.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:55.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:55.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:55.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:55.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:55.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:55.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:55.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:55.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:55.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:55.947 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:15:55.947 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:15:55.953 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:15:55.962 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:15:56.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:56.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:56.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:56.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:56.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:56.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:56.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:56.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:56.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:56.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:56.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:56.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:56.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:56.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:56.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:56.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:56.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:56.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:56.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:56.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:57.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:57.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:57.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:57.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:57.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:57.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:57.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:57.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:57.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:57.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:15:57.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:57.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:57.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:57.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:57.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:57.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:57.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:15:57.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:15:57.458 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:15:57.458 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:15:57.459 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456957 2023-09-23T08:15:57.459 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456957 -le 1695457101 ]] 2023-09-23T08:15:57.459 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:15:57.459 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:15:57.459 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:15:57.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:15:57.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:15:57.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:15:57.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:15:57.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:15:57.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:15:57.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:15:57.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:15:57.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:15:57.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:03.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:03.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:03.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:03.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:03.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:03.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:03.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:03.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:03.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:03.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:03.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:03.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:04.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:04.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:04.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:04.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:04.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:04.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:04.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:04.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:04.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:04.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:04.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:04.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:04.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:04.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:04.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:04.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:04.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:04.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:06.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:06.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:06.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:06.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:06.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:06.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:06.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:06.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:06.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:06.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:06.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:06.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:06.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:06.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:06.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:06.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:06.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:06.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:06.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:07.461 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:16:07.461 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:16:07.461 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:16:07.478 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:16:07.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:07.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:07.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:07.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:07.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:07.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:07.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:07.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:07.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:07.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:07.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:07.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:08.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:08.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:08.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:08.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:08.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:08.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:08.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:08.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:08.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:08.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:08.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:08.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:08.784 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:16:08.784 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:16:08.785 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456968 2023-09-23T08:16:08.785 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456968 -le 1695457101 ]] 2023-09-23T08:16:08.785 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:16:08.785 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:16:08.785 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:16:09.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:09.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:09.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:09.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:09.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:09.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:09.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:09.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:09.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:09.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:09.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:09.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:09.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:09.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:09.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:09.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:09.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:09.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:09.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:09.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:09.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:09.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:09.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:09.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:09.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:09.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:09.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:09.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:09.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:09.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:09.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:09.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:09.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:10.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:10.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:11.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:11.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:11.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:11.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:11.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:11.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:11.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:11.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:11.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:11.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:11.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:11.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:11.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:11.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:12.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:12.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:12.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:12.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:12.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:12.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:12.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:12.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:12.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:12.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:13.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:12.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:13.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:13.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:13.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:13.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:13.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:16:13.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:13.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:13.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:13.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:13.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:14.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:14.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:14.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:13.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:14.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:14.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:14.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:14.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:14.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:14.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:14.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:14.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:14.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:14.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:14.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:14.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:14.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:14.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:14.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:14.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:14.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:14.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:16.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:16.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:16.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:16.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:16.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:16.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:16.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:16.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:16.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:16.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:16.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:16.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:16:16.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:16.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:16.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:16.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:16.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:16.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:16.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:16.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:16.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:16.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:16.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:16.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:16.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:16.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:16.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:16.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:16.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:16.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:16.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:16.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:16.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:16.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:16.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:16.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:16.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:16.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:16.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:16.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:16.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:16.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:16:16.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:16.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:16.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:16.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:16.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:16.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:16.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:16.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:16.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:16.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:16.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:16.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:17.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:17.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:17.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:17.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:17.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:17.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:17.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:17.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:17.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:17.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:17.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:17.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:18.792 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:16:18.792 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:16:18.799 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:16:18.805 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:16:20.327 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:16:20.330 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:16:20.331 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456980 2023-09-23T08:16:20.331 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456980 -le 1695457101 ]] 2023-09-23T08:16:20.331 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:16:20.331 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:16:20.332 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:16:20.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:20.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:20.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:20.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:20.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:20.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:20.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:20.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:20.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:20.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:20.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:20.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:20.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:20.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:20.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:20.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:20.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:20.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:20.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:20.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:20.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:20.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:20.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:20.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:20.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:20.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:21.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:21.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:21.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:21.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:21.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:21.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:21.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:21.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:22.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:22.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:22.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:22.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:22.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:22.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:22.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:22.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:22.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:22.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:22.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:22.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:22.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:22.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:22.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:22.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:22.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:22.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:23.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:23.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:23.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:23.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:23.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:23.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:23.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:23.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:23.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:23.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:23.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:23.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:23.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:23.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:23.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:23.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:23.914 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:16:23.907+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:16:23.914 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:16:23.907+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:16:24.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:24.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:24.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:24.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:24.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:24.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:24.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:24.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:24.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:24.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:24.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:24.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:24.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:24.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:26.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:26.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:26.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:26.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:26.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:26.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:26.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:26.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:26.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:26.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:26.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:26.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:26.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:26.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:26.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:26.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:26.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:26.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:27.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:27.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:27.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:27.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:27.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:27.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:27.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:27.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:27.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:27.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:27.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:27.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:27.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:27.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:27.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:27.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:27.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:27.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:28.295 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:16:28.290+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:16:28.295 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:16:28.290+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:16:30.336 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:16:30.353 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:16:30.356 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:16:30.356 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:16:31.861 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:16:31.862 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:16:31.868 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695456991 2023-09-23T08:16:31.869 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695456991 -le 1695457101 ]] 2023-09-23T08:16:31.869 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:16:31.869 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:16:31.869 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:16:32.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:32.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:32.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:32.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:32.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:32.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:32.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:32.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:32.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:32.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:32.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:32.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:32.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:32.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:32.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:32.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:32.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:32.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:34.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:34.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:34.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:34.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:34.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:34.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:34.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:34.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:34.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:34.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:34.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:34.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:34.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:34.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:34.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:34.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:36.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:36.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:36.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:36.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:36.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:36.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:36.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:36.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:36.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:36.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:36.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:36.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:36.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:36.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:36.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:36.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:36.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:36.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:36.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:37.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:37.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:37.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:37.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:37.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:37.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:37.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:37.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:37.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:37.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:37.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:37.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:37.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:37.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:38.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:38.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:38.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:38.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:38.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:38.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:38.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:38.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:38.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:38.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:38.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:38.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:38.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:38.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:38.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:38.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:39.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:39.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:39.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:39.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:39.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:39.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:39.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:39.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:39.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:39.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:39.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:39.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:39.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:39.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:39.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:39.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:40.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:16:40.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:40.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:40.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:40.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:40.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:40.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:40.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:40.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:40.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:40.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:40.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:40.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:41.762 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:16:41.758+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:16:41.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:41.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:41.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:41.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:41.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:41.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:41.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:41.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:41.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:41.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:41.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:41.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:41.871 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:16:41.876 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:16:41.882 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:16:41.886 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:16:42.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:42.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:42.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:42.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:42.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:42.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:42.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:42.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:42.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:42.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:42.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:42.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:42.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:42.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:43.314 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:16:43.322 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:16:43.324 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695457003 2023-09-23T08:16:43.325 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695457003 -le 1695457101 ]] 2023-09-23T08:16:43.325 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:16:43.325 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:16:43.325 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:16:45.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:45.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:45.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:45.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:45.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:45.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:45.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:45.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:45.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:45.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:45.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:45.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:45.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:45.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:45.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:45.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:45.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:45.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:45.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:45.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:46.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:46.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:46.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:46.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:46.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:46.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:46.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:46.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:46.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:46.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:46.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:16:46.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:46.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:46.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:46.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:46.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:46.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:46.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:46.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:46.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:46.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:46.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:46.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:46.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:46.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:46.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:46.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:46.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:46.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:46.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:46.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:46.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:46.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:46.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:46.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:47.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:47.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:47.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:47.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:47.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:47.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:47.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:47.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:47.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:47.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:47.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:47.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:47.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:47.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:47.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:47.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:49.525 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:16:49.518+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:16:49.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:49.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:49.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:49.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:49.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:49.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:49.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:49.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:49.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:49.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:49.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:49.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:49.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:49.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:49.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:49.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:49.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:49.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:49.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:49.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:53.339 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:16:53.344 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:16:53.351 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:16:53.351 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:16:54.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:54.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:54.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:54.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:54.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:54.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:54.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:54.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:54.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:54.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:54.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:54.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:54.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:54.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:54.911 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:16:54.914 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:16:54.915 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695457014 2023-09-23T08:16:54.915 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695457014 -le 1695457101 ]] 2023-09-23T08:16:54.915 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:16:54.916 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:16:54.916 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:16:55.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:55.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:55.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:55.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:55.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:55.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:55.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:55.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:55.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:55.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:55.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:55.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:55.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:16:55.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:55.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:55.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:55.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:55.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:55.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:55.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:55.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:55.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:56.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:56.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:56.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:56.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:56.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:56.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:56.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:56.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:56.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:56.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:56.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:56.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:56.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:56.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:56.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:56.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:56.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:56.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:57.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:57.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:57.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:57.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:57.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:57.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:57.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:57.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:57.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:57.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:57.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:57.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:16:58.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:58.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:16:58.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:58.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:16:58.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:58.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:16:58.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:58.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:16:58.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:58.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:16:58.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:58.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:16:58.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:58.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:16:58.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:58.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:16:58.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:58.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:16:58.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:16:58.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:00.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:00.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:00.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:00.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:00.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:00.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:00.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:00.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:00.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:00.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:00.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:00.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:00.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:00.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:00.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:00.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:00.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:00.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:00.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:00.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:00.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:00.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:00.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:00.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:00.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:00.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:00.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:00.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:00.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:00.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:00.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:00.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:03.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:03.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:03.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:03.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:03.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:03.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:03.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:03.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:03.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:03.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:03.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:03.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:03.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:03.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:03.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:03.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:03.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:03.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:04.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:04.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:04.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:04.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:04.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:04.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:04.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:04.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:04.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:04.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:04.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:04.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:04.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:04.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:04.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:04.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:04.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:04.921 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:17:04.921 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:17:04.924 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:17:04.929 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:17:05.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:05.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:05.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:05.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:05.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:05.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:05.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:05.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:05.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:05.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:05.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:05.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:05.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:05.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:05.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:05.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:05.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:05.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:05.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:05.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:05.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:05.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:05.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:05.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:05.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:05.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:05.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:05.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:05.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:05.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:05.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:05.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:05.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:06.324 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:17:06.324 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:17:06.325 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695457026 2023-09-23T08:17:06.326 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695457026 -le 1695457101 ]] 2023-09-23T08:17:06.326 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:17:06.326 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:17:06.326 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:17:08.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:08.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:08.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:08.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:08.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:08.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:08.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:08.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:08.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:08.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:08.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:08.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:08.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:08.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:08.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:08.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:08.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:08.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:08.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:08.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:08.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:09.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:09.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:09.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:09.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:09.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:09.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:09.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:09.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:09.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:09.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:09.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:09.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:09.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:09.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:09.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:09.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:09.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:09.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:09.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:09.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:11.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:11.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:11.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:11.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:11.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:11.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:11.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:11.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:11.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:11.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:11.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:11.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:12.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:12.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:12.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:12.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:12.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:12.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:12.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:12.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:12.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:12.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:12.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:12.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:12.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:12.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:12.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:12.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:12.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:12.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:13.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:13.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:13.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:13.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:13.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:13.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:13.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:13.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:13.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:13.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:13.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:13.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:13.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:13.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:13.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:13.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:13.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:13.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:13.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:13.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:13.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:13.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:13.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:13.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:13.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:13.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:13.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:13.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:13.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:13.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:13.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:13.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:13.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:14.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:14.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:14.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:14.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:14.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:14.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:14.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:14.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:14.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:14.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:14.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:14.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:14.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:14.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:14.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:14.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:14.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:14.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:14.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:14.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:14.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:14.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:14.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:14.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:14.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:14.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:14.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:14.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:14.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:14.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:14.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:14.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:14.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:14.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:14.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:14.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:14.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:14.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:14.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:14.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:15.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:15.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:15.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:15.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:15.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:15.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:15.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:15.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:15.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:15.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:15.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:15.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:15.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:15.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:15.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:15.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:15.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:15.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:15.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:15.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:16.329 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:17:16.330 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:17:16.330 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:17:16.330 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:17:16.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:16.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:16.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:16.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:16.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:16.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:16.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:16.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:16.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:16.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:16.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:16.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:16.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:16.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:16.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:16.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:16.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:16.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:17.767 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:17.762+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:17:17.767 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:17.762+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:17:17.767 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:17.762+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:17:17.969 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:17:17.974 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:17:17.976 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695457037 2023-09-23T08:17:17.976 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695457037 -le 1695457101 ]] 2023-09-23T08:17:17.976 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:17:17.976 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:17:17.976 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:17:18.955 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:18.950+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:17:20.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:20.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:20.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:20.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:20.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:20.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:20.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:20.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:20.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:20.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:20.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:20.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:20.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:23.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:23.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:23.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:23.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:23.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:23.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:23.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:23.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:23.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:23.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:23.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:23.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:24.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:23.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:24.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:24.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:24.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:24.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:24.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:24.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:24.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:24.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:25.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:25.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:25.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:25.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:25.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:25.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:25.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:25.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:25.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:25.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:25.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:25.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:25.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:25.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:25.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:25.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:25.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:25.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:25.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:25.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:25.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:25.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:25.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:26.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:26.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:26.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:26.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:26.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:26.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:26.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:26.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:26.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:26.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:26.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:26.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:26.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:26.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:26.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:26.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:26.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:26.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:27.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:27.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:27.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:27.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:27.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:27.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:27.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:27.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:27.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:27.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:27.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:27.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:27.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:27.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:27.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:27.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:27.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:27.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:27.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:27.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:27.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:27.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:27.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:27.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:27.994 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:17:27.994 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:17:28.000 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:17:28.011 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:17:28.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:28.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:28.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:28.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:28.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:28.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:28.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:28.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:28.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:28.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:28.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:28.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:28.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:29.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:29.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:29.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:29.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:29.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:29.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:29.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:29.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:29.435 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:17:29.435 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:17:29.436 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695457049 2023-09-23T08:17:29.436 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695457049 -le 1695457101 ]] 2023-09-23T08:17:29.436 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:17:29.436 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:17:29.436 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:17:29.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:29.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:29.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:29.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:29.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:29.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:29.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:29.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:29.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:29.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:29.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:29.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:29.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:29.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:30.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:30.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:30.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:30.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:30.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:30.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:30.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:30.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:30.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:30.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:30.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:30.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:30.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:30.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:30.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:30.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:30.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:30.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:30.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:30.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:30.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:30.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:30.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:30.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:30.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:30.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:30.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:30.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:31.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:31.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:31.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:31.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:31.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:31.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:31.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:31.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:31.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:31.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:31.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:31.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:31.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:31.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:31.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:31.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:31.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:31.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:31.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:31.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:31.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:31.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:31.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:31.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:31.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:31.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:31.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:31.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:31.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:31.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:31.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:32.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:32.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:32.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:32.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:32.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:32.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:32.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:32.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:32.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:32.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:32.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:32.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:32.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:32.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:32.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:32.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:32.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:32.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:33.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:33.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:33.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:33.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:33.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:33.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:33.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:33.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:33.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:33.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:33.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:33.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:33.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:33.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:33.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:33.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:34.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:34.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:34.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:34.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:34.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:34.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:34.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:34.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:34.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:34.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:34.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:34.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:34.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:34.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:34.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:34.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:34.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:34.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:34.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:34.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:34.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:34.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:34.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:34.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:34.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:34.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:34.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:34.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:34.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:34.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:35.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:35.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:35.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:35.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:35.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:35.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:35.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:35.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:35.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:35.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:35.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:35.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:35.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:35.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:35.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:35.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:35.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:35.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:35.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:36.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:36.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:36.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:36.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:36.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:36.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:36.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:36.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:36.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:36.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:36.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:36.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:36.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:36.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:38.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:38.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:38.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:38.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:38.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:38.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:38.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:38.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:38.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:38.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:38.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:38.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:38.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:38.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:38.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:38.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:38.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:38.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:39.189 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:39.185+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:17:39.189 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:39.185+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:17:39.189 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:39.185+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:17:39.196 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:39.193+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:17:39.196 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:39.193+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:17:39.196 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:39.193+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:17:39.441 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:17:39.441 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:17:39.453 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:17:39.465 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:17:39.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:39.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:39.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:39.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:39.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:39.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:39.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:39.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:39.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:39.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:39.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:39.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:40.084 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:40.081+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:17:40.084 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:40.081+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:17:40.694 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:17:40.695 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:17:40.695 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695457060 2023-09-23T08:17:40.695 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695457060 -le 1695457101 ]] 2023-09-23T08:17:40.695 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:17:40.696 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:17:40.696 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:17:41.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:41.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:41.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:41.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:41.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:41.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:41.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:41.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:41.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:41.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:41.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:41.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:41.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:41.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:41.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:41.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:41.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:43.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:43.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:43.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:43.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:43.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:43.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:43.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:43.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:43.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:43.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:44.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:44.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:43.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:44.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:44.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:44.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:44.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:44.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:44.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:44.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:44.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:44.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:44.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:44.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:44.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:44.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:45.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:45.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:45.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:45.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:45.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:45.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:45.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:45.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:45.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:45.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:45.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:45.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:45.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:45.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:45.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:45.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:45.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:45.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:45.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:45.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:47.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:47.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:47.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:47.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:47.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:47.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:47.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:47.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:47.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:47.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:47.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:47.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:48.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:48.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:48.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:48.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:48.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:48.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:48.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:48.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:48.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:48.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:48.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:48.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:48.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:48.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:48.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:48.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:48.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:48.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:48.721 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:48.717+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:17:48.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:48.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:48.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:48.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:48.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:48.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:48.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:48.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:48.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:49.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:49.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:49.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:49.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:49.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:49.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:49.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:49.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:49.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:49.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:49.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:49.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:49.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:49.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:49.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:49.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:49.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:49.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:49.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:49.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:50.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:50.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:50.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:50.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:50.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:50.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:50.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:50.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:50.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:50.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:50.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:50.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:50.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:50.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:50.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:50.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:50.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:50.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:50.700 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:17:50.700 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:17:50.706 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:17:50.711 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:17:51.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:51.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:51.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:51.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:51.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:51.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:51.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:51.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:51.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:51.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:51.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:51.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:51.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:51.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:51.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:51.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:51.930 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:17:51.931 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:17:51.931 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695457071 2023-09-23T08:17:51.932 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695457071 -le 1695457101 ]] 2023-09-23T08:17:51.932 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:17:51.932 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:17:51.932 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:17:52.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:52.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:52.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:52.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:52.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:52.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:52.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:52.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:52.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:52.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:52.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:52.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:52.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:52.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:52.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:52.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:52.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:52.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:52.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:52.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:54.042 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:54.033+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:17:54.042 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:54.033+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:17:54.043 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:17:54.033+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:17:54.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:54.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:54.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:54.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:54.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:54.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:54.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:54.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:54.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:54.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:54.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:54.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:56.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:56.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:56.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:56.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:56.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:56.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:56.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:56.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:56.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:56.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:56.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:56.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:56.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:56.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:56.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:56.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:56.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:56.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:56.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:56.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:56.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:56.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:56.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:56.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:56.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:56.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:56.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:56.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:56.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:56.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:56.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:56.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:56.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:56.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:56.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:56.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:17:56.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:17:56.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:17:56.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:56.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:56.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:56.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:56.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:56.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:56.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:56.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:56.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:56.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:57.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:57.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:57.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:57.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:57.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:57.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:57.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:57.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:57.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:57.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:57.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:57.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:57.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:57.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:17:58.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:58.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:17:58.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:58.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:17:58.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:58.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:17:58.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:58.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:17:58.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:58.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:17:58.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:58.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:17:58.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:58.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:17:58.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:58.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:17:58.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:17:58.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:01.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:18:01.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:01.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:01.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:01.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:01.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:01.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:01.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:01.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:01.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:01.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:01.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:01.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:01.948 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:18:01.948 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:18:01.955 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:18:01.965 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:18:03.587 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:18:03.589 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:18:03.591 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695457083 2023-09-23T08:18:03.591 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695457083 -le 1695457101 ]] 2023-09-23T08:18:03.591 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:18:03.591 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:18:03.591 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:18:06.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:06.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:06.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:06.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:06.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:06.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:06.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:06.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:06.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:06.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:06.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:06.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:07.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:07.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:07.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:07.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:07.099 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:07.097+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:18:07.112 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:07.109+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:18:07.112 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:07.109+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:18:07.112 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:07.109+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:18:07.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:07.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:07.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:07.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:07.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:07.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:07.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:07.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:09.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:09.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:18:09.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:09.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:09.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:09.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:10.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:09.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:10.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:09.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:10.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:10.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:10.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:10.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:10.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:10.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:10.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:10.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:10.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:10.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:10.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:10.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:10.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:10.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:10.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:10.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:10.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:11.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:11.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:11.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:11.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:11.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:11.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:11.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:11.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:11.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:11.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:11.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:11.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:11.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:11.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:11.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:11.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:11.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:11.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:12.894 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:12.893+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:18:12.895 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:12.893+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:18:12.895 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:12.893+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:18:13.599 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:18:13.600 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:18:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:18:13.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:13.650 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:18:13.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:13.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:13.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:13.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:13.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:13.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:13.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:13.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:13.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:13.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:13.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:13.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:14.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:14.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:14.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:14.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:14.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:14.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:14.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:14.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:14.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:14.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:14.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:14.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:14.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:14.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:14.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:14.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:15.014 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:15.009+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:18:15.033 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:15.029+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:18:15.036 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:15.029+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:18:15.036 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:15.029+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:18:15.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:18:15.217 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:18:15.218 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695457095 2023-09-23T08:18:15.218 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695457095 -le 1695457101 ]] 2023-09-23T08:18:15.218 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ ! -z 172.21.15.107:0/1631903394 ]] 2023-09-23T08:18:15.218 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 172.21.15.107:0/1631903394 != \1\7\2\.\2\1\.\1\5\.\1\0\7\:\0\/\1\6\3\1\9\0\3\3\9\4 ]] 2023-09-23T08:18:15.218 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:18:15.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:15.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:15.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:15.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:15.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:15.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:15.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:15.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:15.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:15.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:15.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:15.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:16.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:16.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:16.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:16.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:16.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:16.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:16.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:16.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:16.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:16.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:16.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:16.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:17.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:17.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:17.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:17.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:17.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:17.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:17.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:17.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:17.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:17.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:17.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:17.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:17.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:17.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:17.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:17.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:17.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:17.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:17.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:17.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:18.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:18.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:18.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:18.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:18.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:18.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:18.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:18.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:18.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:18.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:18.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:18.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:18.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:18.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:18.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:18.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:19.055 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:19.053+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:18:19.552 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:19.549+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:18:19.552 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:19.549+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:18:20.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:18:20.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:20.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:20.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:20.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:20.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:20.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:20.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:20.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:20.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:20.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:20.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:20.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:21.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:21.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:21.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:21.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:21.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:21.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:21.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:21.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:21.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:21.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:21.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:21.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:21.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:21.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:21.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:21.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:21.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:21.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:21.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:21.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:21.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:21.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:21.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:22.700 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:22.697+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:18:22.700 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:22.697+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:18:23.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:23.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:23.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:23.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:23.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:23.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:23.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:23.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:23.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:18:23.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:23.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:23.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:23.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:23.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:23.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:23.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:23.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:23.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:23.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:23.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:23.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:25.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:25.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:25.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:25.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:25.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:25.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:25.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:25.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:25.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:25.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:25.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:25.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:25.225 INFO:tasks.workunit.client.0.smithi107.stderr:++ ceph mgr dump 2023-09-23T08:18:25.238 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq '.active_clients[]' 2023-09-23T08:18:25.238 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-09-23T08:18:25.249 INFO:tasks.workunit.client.0.smithi107.stderr:++ jq 'select(.name == "rbd_support")' 2023-09-23T08:18:26.092 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:26.089+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:18:26.093 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:26.089+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:18:26.093 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:26.089+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:18:26.105 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:26.101+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:18:26.105 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:26.101+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:18:26.106 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:26.101+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:18:26.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:26.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:26.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:26.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:26.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:26.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:26.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:26.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:26.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:26.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:26.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:18:26.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:26.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:26.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:26.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:26.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:26.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:26.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:26.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:26.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:26.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:26.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:26.648 INFO:tasks.workunit.client.0.smithi107.stderr:+ CLIENT_ADDR=172.21.15.107:0/1631903394 2023-09-23T08:18:26.649 INFO:tasks.workunit.client.0.smithi107.stderr:++ date +%s 2023-09-23T08:18:26.650 INFO:tasks.workunit.client.0.smithi107.stderr:+ CURRENT_TIME=1695457106 2023-09-23T08:18:26.650 INFO:tasks.workunit.client.0.smithi107.stderr:+ [[ 1695457106 -le 1695457101 ]] 2023-09-23T08:18:26.650 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i = 1 )) 2023-09-23T08:18:26.650 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:18:26.650 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:18:26.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:26.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:26.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:26.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:26.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:26.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:26.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:26.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:26.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:26.912 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:18:26.909+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:18:26.912 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:18:26.920 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:18:28.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:28.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:28.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:28.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:28.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:28.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:28.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:18:28.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:28.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:28.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:28.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:28.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:28.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:28.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:28.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:28.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:28.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:28.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:28.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:28.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:28.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:30.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:30.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:30.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:30.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:30.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:30.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:30.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:30.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:30.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:30.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:30.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:30.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:30.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:30.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:30.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:30.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:30.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:30.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:30.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:30.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:30.754 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:18:30.753+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:18:31.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:31.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:31.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:31.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:31.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:31.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:31.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:31.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:31.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:31.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:31.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:31.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:31.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:31.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:31.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:31.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:34.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:34.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:34.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:34.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:34.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:34.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:34.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:34.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:34.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:34.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:34.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:34.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:34.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:34.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:34.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:34.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:34.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:34.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:34.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:34.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:34.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:34.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:36.921 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:18:36.921 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:18:36.921 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:18:36.970 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:18:36.964+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:18:36.970 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:18:36.973 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:18:37.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:37.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:37.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:37.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:37.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:37.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:37.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:37.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:37.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:37.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:37.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:37.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:39.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:39.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:39.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:39.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:39.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:39.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:39.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:39.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:39.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:39.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:39.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:39.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:41.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:41.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:41.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:41.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:41.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:41.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:41.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:41.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:41.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:41.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:41.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:41.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:41.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:41.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:41.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:41.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:41.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:41.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:43.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:43.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:43.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:43.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:43.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:43.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:43.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:43.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:43.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:43.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:43.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:43.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:43.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:43.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:43.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:43.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:43.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:43.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:43.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:43.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:43.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:44.542 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:44.536+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:18:44.543 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:44.540+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:18:44.543 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:44.540+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:18:44.543 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:44.540+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:18:44.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:44.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:44.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:44.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:44.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:44.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:44.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:44.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:44.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:44.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:44.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:44.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:44.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:44.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:44.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:44.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:44.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:44.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:45.745 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:45.740+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:18:45.745 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:45.740+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:18:46.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:46.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:46.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:46.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:46.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:46.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:46.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:46.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:46.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:46.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:46.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:46.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:46.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:46.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:46.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:46.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:46.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:46.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:46.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:46.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:46.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:46.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:46.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:46.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:46.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:46.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:46.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:46.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:46.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:46.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:46.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:46.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:46.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:46.974 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:18:46.974 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:18:46.974 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:18:47.081 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:18:47.076+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:18:47.082 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:18:47.123 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:18:47.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:47.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:47.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:47.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:47.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:47.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:47.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:47.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:47.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:47.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:47.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:47.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:47.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:47.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:47.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:47.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:47.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:47.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:47.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:47.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:48.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:48.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:48.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:48.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:48.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:48.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:48.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:48.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:48.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:48.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:48.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:48.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:48.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:48.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:49.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:49.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:49.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:49.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:49.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:49.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:49.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:49.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:49.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:49.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:49.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:49.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:49.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:49.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:49.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:49.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:52.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:52.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:52.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:52.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:52.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:52.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:52.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:52.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:52.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:52.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:52.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:52.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:52.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:52.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:53.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:53.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:53.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:53.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:53.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:53.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:53.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:53.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:53.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:53.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:53.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:53.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:53.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:53.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:55.598 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:55.592+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:18:55.598 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:55.592+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:18:57.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:57.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:57.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:18:57.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:18:57.143 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:18:57.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:57.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:57.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:57.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:57.272 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:18:57.268+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:18:57.273 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:18:57.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:57.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:57.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:57.296 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:18:57.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:57.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:57.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:57.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:57.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:57.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:57.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:57.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:57.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:57.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:57.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:58.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:58.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:58.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:58.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:58.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:58.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:58.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:58.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:58.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:58.332 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:58.328+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:18:58.333 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:18:58.328+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:18:58.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:58.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:58.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:58.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:58.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:58.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:58.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:58.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:58.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:58.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:18:58.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:18:58.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:18:58.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:58.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:58.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:18:58.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:18:58.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:58.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:58.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:58.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:18:58.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:18:58.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:18:58.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:18:58.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:18:58.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:18:58.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:18:58.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:18:58.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:00.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:00.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:00.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:00.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:00.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:00.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:00.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:00.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:00.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:00.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:00.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:00.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:00.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:00.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:00.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:00.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:00.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:00.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:00.877 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:00.872+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:19:00.877 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:00.872+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:01.590 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:01.584+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:19:01.590 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:01.584+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:19:01.590 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:01.584+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:02.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:02.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:02.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:02.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:02.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:02.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:02.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:02.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:02.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:02.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:02.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:02.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:02.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:02.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:02.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:02.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:02.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:02.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:02.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:02.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:03.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:03.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:03.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:03.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:03.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:03.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:03.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:03.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:03.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:03.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:03.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:03.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:03.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:03.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:03.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:03.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:03.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:04.221 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:04.216+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:19:04.221 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:04.216+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:19:04.221 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:04.216+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:05.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:05.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:05.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:05.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:06.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:06.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:06.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:06.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:06.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:06.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:06.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:06.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:06.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:06.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:06.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:06.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:06.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:06.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:06.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:06.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:06.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:06.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:06.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:06.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:07.297 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:19:07.297 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:19:07.297 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:19:07.398 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:19:07.396+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:19:07.399 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:19:07.404 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:19:07.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:07.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:07.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:07.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:07.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:07.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:07.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:07.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:07.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:07.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:07.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:07.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:08.334 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:08.328+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:19:08.334 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:08.328+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:19:08.334 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:08.328+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:09.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:09.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:09.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:09.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:09.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:09.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:09.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:09.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:09.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:09.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:09.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:09.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:09.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:09.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:09.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:09.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:09.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:09.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:10.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:10.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:10.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:10.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:10.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:10.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:10.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:10.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:10.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:10.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:10.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:10.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:11.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:11.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:11.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:11.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:11.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:11.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:11.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:11.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:11.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:11.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:11.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:11.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:11.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:11.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:11.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:11.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:12.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:12.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:12.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:12.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:12.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:12.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:12.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:12.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:12.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:12.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:12.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:12.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:15.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:15.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:15.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:15.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:15.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:15.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:15.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:15.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:15.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:15.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:16.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:16.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:16.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:16.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:16.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:16.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:16.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:16.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:16.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:16.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:16.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:16.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:16.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:16.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:16.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:16.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:17.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:19:17.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:17.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:17.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:17.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:17.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:17.406 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:19:17.406 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:19:17.406 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:19:17.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:17.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:17.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:17.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:17.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:17.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:17.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:17.548 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:19:17.544+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:19:17.549 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:19:17.560 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:19:18.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:18.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:18.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:18.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:18.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:18.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:18.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:18.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:18.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:18.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:18.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:18.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:18.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:18.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:18.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:18.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:18.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:19.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:19.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:19.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:19.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:19.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:19.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:19.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:19.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:19.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:19.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:19.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:19.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:19.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:19.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:19.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:19.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:19.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:19.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:19.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:19.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:24.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:24.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:24.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:24.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:24.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:24.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:24.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:24.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:24.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:24.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:24.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:24.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:24.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:24.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:24.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:25.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:25.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:25.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:25.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:25.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:25.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:25.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:25.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:25.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:25.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:25.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:25.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:25.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:25.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:25.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:25.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:25.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:25.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:27.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:27.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:27.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:27.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:27.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:27.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:27.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:27.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:27.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:27.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:27.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:27.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:27.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:27.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:27.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:27.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:27.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:27.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:27.561 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:19:27.561 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:19:27.561 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:19:27.659 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:19:27.656+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:19:27.661 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:19:27.683 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:19:32.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:32.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:32.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:32.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:32.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:32.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:32.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:32.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:32.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:32.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:32.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:32.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:32.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:32.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:32.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:32.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:33.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:33.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:33.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:33.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:33.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:33.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:33.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:33.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:33.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:33.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:33.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:33.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:33.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:33.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:33.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:33.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:33.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:33.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:34.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:34.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:34.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:34.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:34.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:34.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:34.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:34.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:34.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:34.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:34.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:34.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:34.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:34.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:34.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:34.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:35.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:34.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:35.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:34.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:35.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:35.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:35.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:35.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:35.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:19:35.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:35.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:35.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:35.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:35.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:35.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:35.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:35.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:35.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:35.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:35.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:35.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:19:35.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:35.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:35.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:35.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:35.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:35.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:35.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:35.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:35.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:35.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:35.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:35.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:19:35.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:35.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:35.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:35.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:35.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:35.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:35.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:35.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:35.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:37.688 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:19:37.688 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:19:37.688 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:19:37.817 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:19:37.811+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:19:37.818 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:19:37.825 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:19:38.163 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:38.159+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:19:38.163 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:38.159+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:19:38.163 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:38.159+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:38.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:38.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:38.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:38.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:38.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:38.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:38.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:38.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:19:38.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:38.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:38.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:38.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:38.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:38.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:38.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:38.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:38.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:40.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:40.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:40.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:40.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:40.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:40.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:40.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:40.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:40.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:40.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:40.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:40.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:40.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:40.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:40.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:40.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:40.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:40.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:40.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:40.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:41.300 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:41.295+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:42.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:42.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:42.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:42.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:42.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:42.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:42.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:42.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:42.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:42.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:42.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:42.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:42.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:42.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:42.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:42.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:42.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:42.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:42.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:42.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:42.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:43.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:43.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:43.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:43.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:43.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:43.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:43.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:43.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:43.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:43.418 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:43.411+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:19:43.418 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:43.411+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:19:43.418 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:43.411+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:43.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:43.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:43.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:44.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:44.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:44.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:44.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:44.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:44.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:44.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:44.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:44.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:44.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:45.589 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:45.583+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:19:45.589 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:45.583+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:19:45.590 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:45.583+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:45.770 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:45.763+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:19:45.770 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:45.763+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:19:45.770 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:45.763+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:46.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:46.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:46.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:46.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:46.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:46.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:46.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:46.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:46.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:46.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:46.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:46.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:46.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:46.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:46.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:46.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:46.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:19:46.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:46.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:46.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:46.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:46.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:46.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:46.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:46.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:46.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:46.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:46.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:46.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:46.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:46.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:46.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:46.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:46.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:46.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:46.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:46.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:46.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:46.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:46.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:47.615 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:47.603+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:19:47.622 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:47.615+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:19:47.622 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:47.615+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:47.839 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:19:47.839 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:19:47.839 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:19:47.986 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:19:47.979+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:19:47.986 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:19:48.013 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:19:48.085 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:48.079+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:48.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:48.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:48.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:48.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:48.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:48.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:48.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:48.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:49.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:48.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:49.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:48.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:49.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:49.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:49.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:49.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:49.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:49.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:49.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:49.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:49.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:49.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:49.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:49.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:49.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:49.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:49.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:49.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:49.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:49.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:49.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:49.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:49.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:49.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:49.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:49.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:50.393 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:50.387+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:19:50.394 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:50.387+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:51.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:51.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:51.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:51.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:51.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:51.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:51.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:51.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:51.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:51.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:51.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:51.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:51.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:51.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:51.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:51.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:51.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:51.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:51.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:51.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:52.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:52.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:52.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:52.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:52.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:52.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:52.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:52.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:52.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:52.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:52.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:52.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:52.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:52.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:52.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:52.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:52.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:52.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:52.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:52.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:52.501 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:52.495+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:54.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:54.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:54.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:54.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:54.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:54.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:54.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:54.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:54.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:54.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:54.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:54.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:54.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:54.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:54.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:54.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:54.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:54.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:55.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:55.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:55.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:55.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:55.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:55.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:55.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:55.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:55.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:55.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:55.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:55.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:55.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:55.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:55.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:55.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:55.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:55.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:55.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:56.057 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:19:56.051+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:19:56.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:56.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:56.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:56.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:56.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:56.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:56.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:56.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:56.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:56.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:56.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:56.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:19:56.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:19:56.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:56.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:56.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:56.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:56.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:56.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:56.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:56.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:56.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:19:56.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:56.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:19:58.024 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:19:58.024 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:19:58.024 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:19:58.134 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:19:58.127+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:19:58.134 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:19:58.154 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:19:59.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:19:59.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:19:59.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:19:59.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:19:59.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:19:59.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:19:59.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:19:59.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:19:59.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:00.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:00.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:00.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:19:59.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:00.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:20:00.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:00.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:00.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:00.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:00.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:00.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:00.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:00.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:00.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:00.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:00.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:00.171 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:00.163+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:00.171 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:00.163+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:00.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:00.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:00.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:00.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:00.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:00.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:20:00.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:00.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:00.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:00.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:00.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:00.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:00.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:00.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:00.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:00.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:00.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:00.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:00.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:00.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:00.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:00.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:00.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:00.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:01.105 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:01.099+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:20:01.105 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:01.099+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:01.106 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:01.099+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:01.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:01.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:01.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:01.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:01.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:01.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:01.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:01.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:01.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:01.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:01.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:01.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:01.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:01.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:01.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:04.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:04.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:04.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:04.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:04.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:04.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:04.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:04.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:05.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:05.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:05.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:05.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:05.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:05.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:05.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:05.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:05.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:05.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:05.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:05.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:05.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:05.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:05.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:05.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:06.197 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:06.191+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:06.197 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:06.191+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:08.156 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:20:08.156 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:20:08.156 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:20:08.337 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:20:08.331+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:20:08.338 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:20:08.355 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:20:08.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:08.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:08.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:08.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:08.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:08.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:08.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:08.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:08.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:08.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:08.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:08.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:12.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:12.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:20:12.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:12.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:12.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:12.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:12.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:12.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:12.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:12.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:12.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:12.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:13.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:13.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:13.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:13.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:13.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:13.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:13.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:20:13.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:13.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:13.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:13.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:13.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:13.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:13.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:13.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:13.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:13.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:13.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:13.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:15.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:15.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:15.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:15.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:15.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:15.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:15.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:15.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:15.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:15.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:20:15.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:15.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:15.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:15.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:15.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:15.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:15.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:15.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:15.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:15.488 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:15.483+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:20:15.488 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:15.483+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:20:15.488 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:15.483+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:20:15.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:15.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:15.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:15.515 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:15.511+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:20:15.515 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:15.511+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:15.515 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:15.511+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:17.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:17.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:17.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:17.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:17.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:17.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:17.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:17.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:17.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:17.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:17.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:17.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:17.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:17.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:17.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:17.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:17.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:17.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:18.323 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:18.319+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:18.323 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:18.319+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:18.356 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:20:18.357 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:20:18.357 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:20:18.479 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:20:18.475+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:20:18.479 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:20:18.492 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:20:18.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:18.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:19.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:18.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:19.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:18.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:19.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:19.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:19.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:19.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:19.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:19.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:19.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:19.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:19.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:19.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:22.331 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:22.323+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:22.331 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:22.323+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:23.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:23.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:23.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:23.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:23.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:23.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:23.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:23.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:23.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:23.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:23.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:23.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:24.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:23.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:24.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:24.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:24.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:24.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:24.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:24.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:24.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:24.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:24.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:24.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:24.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:24.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:24.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:24.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:24.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:24.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:24.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:24.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:25.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:25.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:25.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:25.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:25.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:25.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:25.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:25.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:25.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:25.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:25.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:25.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:25.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:25.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:26.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:26.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:26.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:26.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:26.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:26.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:26.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:26.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:26.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:26.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:26.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:26.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:26.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:26.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:26.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:26.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:26.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:26.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:27.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:27.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:27.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:27.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:27.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:27.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:27.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:27.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:27.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:27.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:27.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:27.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:27.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:27.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:27.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:27.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:27.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:27.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:27.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:27.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:28.494 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:20:28.495 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:20:28.495 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:20:28.602 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:20:28.595+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:20:28.605 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:20:28.616 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:20:29.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:29.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:29.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:29.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:29.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:29.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:29.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:29.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:29.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:29.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:29.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:29.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:29.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:29.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:29.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:29.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:29.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:29.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:30.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:30.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:30.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:30.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:30.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:30.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:30.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:30.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:30.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:30.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:30.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:30.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:30.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:30.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:30.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:30.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:30.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:30.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:30.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:30.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:30.876 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:30.871+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:30.877 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:30.871+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:31.190 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:31.183+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:31.190 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:31.183+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:32.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:32.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:32.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:32.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:32.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:32.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:32.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:32.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:32.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:32.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:32.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:32.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:34.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:34.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:34.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:34.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:34.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:34.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:34.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:34.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:34.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:34.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:34.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:34.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:34.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:34.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:34.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:34.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:35.511 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:35.503+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:20:35.511 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:35.503+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:35.511 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:35.503+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:38.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:38.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:38.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:38.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:38.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:38.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:38.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:38.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:38.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:38.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:38.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:38.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:38.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:38.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:38.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:38.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:38.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:38.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:38.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:38.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:38.618 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:20:38.618 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:20:38.618 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:20:38.775 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:20:38.771+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:20:38.775 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:20:38.808 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:20:39.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:39.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:39.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:39.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:39.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:39.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:39.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:39.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:39.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:39.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:39.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:39.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:39.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:39.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:39.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:39.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:41.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:41.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:41.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:41.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:41.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:41.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:41.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:41.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:41.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:41.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:41.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:41.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:41.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:41.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:41.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:42.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:42.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:42.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:42.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:42.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:42.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:42.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:42.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:42.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:42.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:42.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:42.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:46.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:46.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:46.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:46.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:46.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:46.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:46.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:46.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:46.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:46.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:46.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:46.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:46.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:46.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:46.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:46.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:48.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:48.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:48.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:48.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:48.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:48.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:48.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:48.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:48.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:48.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:48.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:48.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:48.809 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:20:48.809 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:20:48.809 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:20:48.940 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:20:48.930+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:20:48.940 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:20:48.968 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:20:49.093 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:49.086+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:49.093 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:49.086+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:50.326 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:50.318+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:50.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:50.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:50.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:50.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:50.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:50.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:50.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:50.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:51.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:51.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:51.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:51.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:51.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:51.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:51.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:51.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:51.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:51.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:51.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:51.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:51.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:51.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:51.515 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:51.510+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:52.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:52.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:52.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:52.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:52.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:52.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:52.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:52.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:52.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:52.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:52.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:52.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:52.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:52.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:52.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:52.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:52.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:52.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:52.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:52.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:52.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:53.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:53.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:53.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:53.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:53.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:53.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:53.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:53.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:53.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:53.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:53.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:53.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:53.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:53.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:53.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:53.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:53.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:53.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:53.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:53.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:53.794 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:53.786+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:20:53.794 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:53.786+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:53.794 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:53.786+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:54.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:54.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:54.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:54.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:54.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:54.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:54.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:54.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:54.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:54.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:54.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:54.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:54.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:54.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:54.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:54.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:55.277 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:55.270+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:20:55.277 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:55.270+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:20:55.277 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:55.270+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:55.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:55.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:55.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:55.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:55.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:55.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:55.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:55.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:55.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:55.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:55.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:55.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:55.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:55.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:55.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:55.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:55.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:55.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:55.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:55.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:56.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:56.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:56.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:56.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:56.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:56.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:56.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:56.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:56.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:56.594 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:20:56.586+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:20:56.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:56.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:56.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:56.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:56.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:56.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:56.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:56.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:56.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:56.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:56.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:56.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:58.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:58.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:58.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:58.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:58.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:58.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:58.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:20:58.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:20:58.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:58.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:58.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:58.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:20:58.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:20:58.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:20:58.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:20:58.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:20:58.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:20:58.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:20:58.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:20:58.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:20:58.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:20:58.973 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:20:58.974 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:20:58.974 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:20:59.113 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:20:59.106+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:20:59.113 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:20:59.141 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:21:00.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:21:00.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:00.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:00.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:00.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:00.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:00.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:00.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:00.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:00.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:00.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:00.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:00.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:03.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:03.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:03.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:03.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:03.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:03.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:03.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:03.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:03.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:03.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:03.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:03.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:04.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:04.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:04.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:04.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:04.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:04.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:04.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:04.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:04.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:04.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:04.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:04.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:04.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:04.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:04.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:04.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:04.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:04.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:04.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:05.723 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:05.714+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:21:05.723 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:05.714+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:21:05.723 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:05.714+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:21:06.150 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:06.138+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:21:06.150 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:06.138+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:21:06.150 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:06.138+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:21:06.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:06.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:06.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:06.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:06.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:06.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:08.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:08.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:08.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:08.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:08.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:08.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:09.142 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:21:09.142 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:21:09.142 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:21:09.258 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:21:09.254+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:21:09.259 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:21:09.282 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:21:11.642 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:11.634+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:21:11.642 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:11.634+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:21:12.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:12.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:12.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:12.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:12.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:12.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:12.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:12.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:12.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:12.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:12.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:12.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:12.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:12.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:12.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:12.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:12.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:12.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:14.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:14.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:14.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:14.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:14.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:14.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:14.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:14.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:14.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:14.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:14.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:14.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:14.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:14.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:14.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:18.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:18.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:18.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:18.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:18.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:18.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:18.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:18.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:18.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:18.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:18.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:18.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:18.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:18.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:18.474 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:18.466+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:21:19.287 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:21:19.287 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:21:19.287 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:21:19.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:19.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:19.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:19.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:19.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:19.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:19.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:19.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:19.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:19.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:19.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:19.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:19.422 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:21:19.418+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:21:19.428 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:21:19.445 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:21:20.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:20.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:20.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:20.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:20.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:20.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:20.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:20.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:20.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:20.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:20.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:20.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:20.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:20.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:20.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:20.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:20.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:20.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:21.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:21.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:21.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:21.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:21.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:21.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:21.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:21.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:21.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:21.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:21.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:21.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:21.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:21.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:21.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:21.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:21.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:21.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:21.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:21.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:26.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:26.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:26.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:26.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:26.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:26.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:26.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:26.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:26.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:26.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:26.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:26.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:26.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:26.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:26.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:26.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:26.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:26.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:26.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:26.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:26.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:27.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:27.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:27.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:27.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:27.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:27.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:27.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:27.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:27.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:27.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:27.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:27.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:27.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:27.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:27.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:27.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:27.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:27.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:27.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:27.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:27.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:27.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:27.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:27.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:27.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:27.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:21:27.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:27.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:27.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:27.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:27.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:27.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:27.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:27.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:27.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:27.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:28.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:28.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:28.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:28.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:28.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:28.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:28.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:28.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:28.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:28.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:28.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:28.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:28.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:28.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:28.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:28.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:28.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:28.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:28.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:28.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:29.212 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:29.206+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:21:29.212 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:29.206+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:21:29.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:21:29.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:21:29.447 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:21:29.641 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:21:29.638+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:21:29.641 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:21:29.670 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:21:30.167 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:30.162+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:21:30.167 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:30.162+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:21:30.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:30.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:30.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:30.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:30.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:30.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:30.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:30.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:30.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:30.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:30.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:30.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:30.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:30.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:30.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:30.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:30.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:30.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:30.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:31.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:31.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:31.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:31.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:31.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:31.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:31.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:31.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:31.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:31.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:31.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:31.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:31.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:31.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:31.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:31.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:31.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:31.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:33.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:33.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:33.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:33.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:33.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:33.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:33.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:33.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:33.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:33.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:33.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:33.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:36.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:36.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:36.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:36.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:36.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:36.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:36.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:36.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:36.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:36.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:36.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:36.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:36.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:36.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:36.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:36.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:36.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:36.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:36.790 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:36.786+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:21:36.797 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:36.794+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:21:36.797 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:36.794+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:21:36.816 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:36.810+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:21:36.816 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:36.810+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:21:36.816 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:36.810+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:21:37.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:37.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:37.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:37.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:37.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:37.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:37.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:37.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:37.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:37.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:37.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:37.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:37.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:37.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:37.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:37.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:37.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:37.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:37.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:37.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:38.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:38.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:38.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:38.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:38.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:38.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:38.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:38.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:38.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:38.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:38.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:38.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:38.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:38.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:38.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:38.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:38.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:38.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:38.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:38.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:38.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:39.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:39.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:39.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:39.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:39.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:39.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:39.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:39.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:39.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:39.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:39.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:39.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:39.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:39.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:39.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:39.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:39.676 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:21:39.677 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:21:39.677 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:21:39.811 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:21:39.810+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:21:39.812 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:21:39.829 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:21:41.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:41.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:41.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:41.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:41.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:41.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:41.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:41.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:41.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:41.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:41.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:41.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:41.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:41.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:41.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:41.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:41.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:41.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:41.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:41.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:42.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:42.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:42.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:42.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:42.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:42.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:42.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:42.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:42.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:42.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:42.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:42.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:42.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:42.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:42.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:42.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:42.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:42.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:44.085 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:44.077+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:21:44.085 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:44.077+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:21:44.085 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:21:44.077+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:21:47.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:47.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:47.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:47.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:47.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:47.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:47.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:47.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:47.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:47.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:47.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:47.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:47.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:47.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:47.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:47.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:47.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:47.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:47.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:47.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:47.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:47.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:47.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:47.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:47.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:48.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:48.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:48.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:48.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:48.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:48.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:48.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:48.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:48.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:48.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:48.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:48.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:48.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:49.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:49.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:49.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:49.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:49.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:49.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:49.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:49.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:21:49.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:49.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:49.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:49.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:49.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:49.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:49.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:49.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:49.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:49.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:49.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:49.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:49.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:49.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:49.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:49.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:49.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:49.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:49.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:49.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:49.847 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:21:49.847 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:21:49.847 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:21:49.973 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:21:49.969+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:21:49.974 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:21:50.017 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:21:51.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:51.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:51.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:51.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:51.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:51.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:51.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:51.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:51.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:51.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:51.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:51.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:51.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:51.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:51.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:51.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:51.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:51.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:54.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:54.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:21:54.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:54.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:54.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:54.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:54.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:54.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:54.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:54.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:54.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:54.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:54.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:54.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:54.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:54.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:54.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:54.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:54.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:54.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:57.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:57.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:57.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:57.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:57.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:57.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:57.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:57.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:57.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:57.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:21:57.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:21:57.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:21:57.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:21:57.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:21:57.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:21:57.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:21:57.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:21:57.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:21:57.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:21:57.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:21:57.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:00.019 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:22:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:22:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:22:00.172 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:22:00.174 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:22:00.169+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:22:00.178 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:22:04.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:04.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:04.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:04.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:04.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:04.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:04.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:04.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:04.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:04.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:04.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:04.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:05.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:05.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:05.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:05.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:05.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:05.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:05.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:05.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:05.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:05.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:05.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:05.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:05.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:05.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:05.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:05.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:05.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:05.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:06.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:06.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:06.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:06.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:06.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:06.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:06.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:06.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:06.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:06.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:06.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:06.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:06.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:06.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:06.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:06.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:06.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:06.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:06.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:06.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:07.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:07.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:07.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:07.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:07.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:07.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:07.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:07.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:07.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:07.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:07.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:07.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:07.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:07.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:07.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:07.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:07.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:07.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:08.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:08.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:08.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:08.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:08.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:08.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:08.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:08.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:08.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:08.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:08.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:08.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:08.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:08.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:08.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:08.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:08.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:08.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:10.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:22:10.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:22:10.180 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:22:10.327 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:22:10.325+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:22:10.328 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:22:10.357 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:22:13.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:13.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:13.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:13.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:13.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:13.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:13.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:13.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:13.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:13.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:13.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:13.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:13.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:13.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:13.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:13.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:13.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:13.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:13.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:13.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:13.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:13.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:13.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:13.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:13.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:13.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:13.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:13.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:13.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:13.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:14.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:14.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:14.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:14.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:14.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:14.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:14.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:14.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:14.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:14.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:14.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:14.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:14.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:14.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:14.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:14.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:14.466 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:14.461+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:22:14.467 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:14.461+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:22:14.467 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:14.461+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:22:15.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:15.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:15.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:15.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:15.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:15.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:15.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:15.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:15.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:15.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:15.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:15.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:16.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:16.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:16.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:16.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:16.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:16.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:16.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:16.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:16.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:16.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:16.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:16.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:16.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:16.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:16.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:16.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:16.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:16.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:16.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:17.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:17.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:17.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:17.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:17.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:17.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:17.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:17.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:17.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:17.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:17.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:17.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:17.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:17.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:17.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:17.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:17.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:17.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:18.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:18.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:18.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:18.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:18.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:18.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:18.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:18.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:18.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:18.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:18.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:18.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:18.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:18.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:18.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:18.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:18.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:18.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:18.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:20.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:20.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:20.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:20.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:20.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:20.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:20.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:20.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:20.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:20.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:20.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:20.358 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:22:20.358 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:22:20.358 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-09-23T08:22:20.489 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:22:20.485+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:22:20.489 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:22:20.499 INFO:tasks.workunit.client.0.smithi107.stderr:+ sleep 10 2023-09-23T08:22:20.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:20.823 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:20.817+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:22:20.823 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:20.817+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:22:20.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:20.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:20.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:20.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:20.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:20.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:20.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:20.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:20.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:20.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:20.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:20.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:21.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:21.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:21.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:21.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:21.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:21.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:21.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:21.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:21.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:21.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:21.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:21.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:21.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:21.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:21.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:21.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:21.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:21.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:21.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:22.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:22.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:22.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:22.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:22.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:22.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:22.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:22.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:22.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:22.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:22.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:22.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:22.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:22.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:22.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:22.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:22.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:22.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:22.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:22.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:22.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:22.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:22.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:22.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:22.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:22.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:22.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:22.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:22.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:22.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:22.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:22.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:22.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:22.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:22.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:22.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:22.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:22.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:22.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:22.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:22.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:22.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:22.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:22.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:22.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:22.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:22.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:22.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:22.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:22.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:22.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:22.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:22.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:22.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:22.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:22.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:23.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:23.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:23.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:23.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:23.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:23.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:23.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:23.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:23.737 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:23.733+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:22:23.737 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:23.733+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:22:23.738 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:23.733+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:22:23.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:23.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:23.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:23.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:23.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:25.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:25.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:25.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:25.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:25.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:25.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:25.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:25.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:25.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:25.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:25.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:25.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:25.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:25.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:25.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:25.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:25.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:25.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:25.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:25.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:25.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:25.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:25.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:25.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:25.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:25.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:25.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:25.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:25.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:25.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:25.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:25.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:25.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:25.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:29.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:29.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:29.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:29.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:29.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:29.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:29.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:29.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:29.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:29.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:29.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:29.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:29.725 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:29.721+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:22:29.725 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:29.721+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:22:29.726 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:29.721+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:22:29.734 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:29.729+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:22:29.735 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:29.729+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:22:29.735 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:29.729+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:22:30.508 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i++ )) 2023-09-23T08:22:30.508 INFO:tasks.workunit.client.0.smithi107.stderr:+ (( i <= 24 )) 2023-09-23T08:22:30.508 INFO:tasks.workunit.client.0.smithi107.stderr:+ grep 'every 2m' 2023-09-23T08:22:30.511 INFO:tasks.workunit.client.0.smithi107.stderr:+ rbd mirror snapshot schedule ls -p rbd --image image1 2023-09-23T08:22:30.654 INFO:tasks.ceph.mgr.x.smithi107.stderr:2023-09-23T08:22:30.649+0000 7f9a15256640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-09-23T08:22:30.657 INFO:tasks.workunit.client.0.smithi107.stderr:rbd: rbd mirror snapshot schedule list failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-09-23T08:22:30.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T08:22:30.690 INFO:tasks.workunit:Stopping ['rbd/rbd_support_module_recovery.sh'] on client.0... 2023-09-23T08:22:30.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-09-23T08:22:31.491 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/rbd_support_module_recovery.sh) on smithi107 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_support_module_recovery.sh' 2023-09-23T08:22:31.557 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=79fa5b56da624f3eab4062dd84fff27b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/rbd_support_module_recovery.sh) on smithi107 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_support_module_recovery.sh' 2023-09-23T08:22:31.560 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-23T08:22:31.606 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-23T08:22:31.615 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-23T08:22:31.615 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:22:32.393 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:22:32.393 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:22:32.427 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2052,"stamp":"2023-09-23T08:22:32.223734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22452219211,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":1959359,"num_read_kb":7684882,"num_write":1938648,"num_write_kb":7754963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80352,"ondisk_log_size":80352,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20104864,"kb_used_data":15504712,"kb_used_omap":1200,"kb_used_meta":4598927,"kb_avail":263010656,"statfs":{"total":289910292480,"available":269322911744,"internally_reserved":0,"allocated":15876825088,"data_stored":20126738212,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1229219,"internal_metadata":4709301853},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,2,2,11,25,14,13,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16846848,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4771,"num_read_kb":18992,"num_write":4853,"num_write_kb":19412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001665"},"pg_stats":[{"pgid":"2.7","version":"79'240611","reported_seq":473023,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.149556+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:22:31.149556+0000","last_peered":"2023-09-23T08:22:31.149556+0000","last_clean":"2023-09-23T08:22:31.149556+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:22:31.149556+0000","last_undegraded":"2023-09-23T08:22:31.149556+0000","last_fullsized":"2023-09-23T08:22:31.149556+0000","mapping_epoch":13,"log_start":"76'230610","ondisk_log_start":"76'230610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:05:32.293565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2649526607,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":232277,"num_read_kb":911102,"num_write":229032,"num_write_kb":916032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"79'264078","reported_seq":519687,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.130447+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:22:31.130447+0000","last_peered":"2023-09-23T08:22:31.130447+0000","last_clean":"2023-09-23T08:22:31.130447+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:22:31.130447+0000","last_undegraded":"2023-09-23T08:22:31.130447+0000","last_fullsized":"2023-09-23T08:22:31.130447+0000","mapping_epoch":13,"log_start":"76'254007","ondisk_log_start":"76'254007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:30:29.542713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2950639935,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":256244,"num_read_kb":1001006,"num_write":252535,"num_write_kb":1009909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"79'251013","reported_seq":492693,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.140118+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:22:31.140118+0000","last_peered":"2023-09-23T08:22:31.140118+0000","last_clean":"2023-09-23T08:22:31.140118+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:22:31.140118+0000","last_undegraded":"2023-09-23T08:22:31.140118+0000","last_fullsized":"2023-09-23T08:22:31.140118+0000","mapping_epoch":13,"log_start":"76'241009","ondisk_log_start":"76'241009","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:42:21.202107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2756059436,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":241530,"num_read_kb":947305,"num_write":239457,"num_write_kb":957741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"79'254943","reported_seq":510406,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.129115+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:22:31.129115+0000","last_peered":"2023-09-23T08:22:31.129115+0000","last_clean":"2023-09-23T08:22:31.129115+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:22:31.129115+0000","last_undegraded":"2023-09-23T08:22:31.129115+0000","last_fullsized":"2023-09-23T08:22:31.129115+0000","mapping_epoch":13,"log_start":"76'244907","ondisk_log_start":"76'244907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:45:12.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2946265370,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":256123,"num_read_kb":1010563,"num_write":254155,"num_write_kb":1016533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"79'248424","reported_seq":496083,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:30.990820+0000","last_change":"2023-09-23T07:31:04.433973+0000","last_active":"2023-09-23T08:22:30.990820+0000","last_peered":"2023-09-23T08:22:30.990820+0000","last_clean":"2023-09-23T08:22:30.990820+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:22:30.990820+0000","last_undegraded":"2023-09-23T08:22:30.990820+0000","last_fullsized":"2023-09-23T08:22:30.990820+0000","mapping_epoch":13,"log_start":"76'238407","ondisk_log_start":"76'238407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:17:37.031069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2841981246,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":247869,"num_read_kb":972463,"num_write":246081,"num_write_kb":984174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"79'256914","reported_seq":510493,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.810342+0000","last_change":"2023-09-23T07:31:04.563014+0000","last_active":"2023-09-23T08:22:31.810342+0000","last_peered":"2023-09-23T08:22:31.810342+0000","last_clean":"2023-09-23T08:22:31.810342+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:22:31.810342+0000","last_undegraded":"2023-09-23T08:22:31.810342+0000","last_fullsized":"2023-09-23T08:22:31.810342+0000","mapping_epoch":13,"log_start":"76'246911","ondisk_log_start":"76'246911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:23:49.806180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2926395862,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":253610,"num_read_kb":994096,"num_write":251618,"num_write_kb":1006352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"79'234749","reported_seq":466900,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.793797+0000","last_change":"2023-09-23T07:31:04.436558+0000","last_active":"2023-09-23T08:22:31.793797+0000","last_peered":"2023-09-23T08:22:31.793797+0000","last_clean":"2023-09-23T08:22:31.793797+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:22:31.793797+0000","last_undegraded":"2023-09-23T08:22:31.793797+0000","last_fullsized":"2023-09-23T08:22:31.793797+0000","mapping_epoch":13,"log_start":"76'224707","ondisk_log_start":"76'224707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:54:10.667393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2655633709,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":231954,"num_read_kb":909241,"num_write":229534,"num_write_kb":918049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"79'247685","reported_seq":487369,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.135137+0000","last_change":"2023-09-23T07:31:06.964056+0000","last_active":"2023-09-23T08:22:31.135137+0000","last_peered":"2023-09-23T08:22:31.135137+0000","last_clean":"2023-09-23T08:22:31.135137+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:22:31.135137+0000","last_undegraded":"2023-09-23T08:22:31.135137+0000","last_fullsized":"2023-09-23T08:22:31.135137+0000","mapping_epoch":13,"log_start":"76'237604","ondisk_log_start":"76'237604","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T07:58:45.409451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2725126678,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":239646,"num_read_kb":939015,"num_write":236099,"num_write_kb":944279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":237,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-09-23T08:22:10.500898+0000","last_change":"2023-09-23T07:16:44.817065+0000","last_active":"2023-09-23T08:22:10.500898+0000","last_peered":"2023-09-23T08:22:10.500898+0000","last_clean":"2023-09-23T08:22:10.500898+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:22:10.500898+0000","last_undegraded":"2023-09-23T08:22:10.500898+0000","last_fullsized":"2023-09-23T08:22:10.500898+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_clean_scrub_stamp":"2023-09-23T07:16:43.255638+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:01:32.785546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22451628843,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":1959253,"num_read_kb":7684791,"num_write":1938511,"num_write_kb":7753069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15878012928,"data_stored":20128028246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80255,"ondisk_log_size":80255,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739160,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4254808,"kb_used_data":2869264,"kb_used_omap":219,"kb_used_meta":1385316,"kb_avail":90117032,"statfs":{"total":96636764160,"available":92279840768,"internally_reserved":0,"allocated":2938126336,"data_stored":3716092915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1418564429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,0,1,4,5,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85299999999999998,"15min":0.60299999999999998},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":8.2270000000000003,"5min":8.2270000000000003,"15min":8.2270000000000003},"last":0.217},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.087,"15min":0.98499999999999999},"min":{"1min":0.22500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":8.2629999999999999,"5min":8.2629999999999999,"15min":25.483000000000001},"last":4.2750000000000004}]},{"osd":1,"last update":"Sat Sep 23 08:21:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.95399999999999996,"15min":0.78700000000000003},"min":{"1min":0.219,"5min":0.215,"15min":0.215},"max":{"1min":11.65,"5min":11.65,"15min":25.550000000000001},"last":0.307},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85799999999999998,"15min":0.76700000000000002},"min":{"1min":0.224,"5min":0.182,"15min":0.182},"max":{"1min":5.875,"5min":7.0350000000000001,"15min":8.125},"last":0.436}]}]},{"osd":1,"up_from":8,"seq":34359739150,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9617616,"kb_used_data":7751496,"kb_used_omap":603,"kb_used_meta":1865508,"kb_avail":84754224,"statfs":{"total":96636764160,"available":86788325376,"internally_reserved":0,"allocated":7937531904,"data_stored":10062683173,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":618493,"internal_metadata":1910280195},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,0,9,16,5,5,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":0.84599999999999997,"15min":0.73199999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":10.25,"5min":10.25,"15min":10.25},"last":0.27200000000000002},{"interface":"front","average":{"1min":1.234,"5min":0.89700000000000002,"15min":0.77900000000000003},"min":{"1min":0.187,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.665,"5min":7.5410000000000004,"15min":9.8849999999999998},"last":0.36099999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":0.996,"15min":0.88600000000000001},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":11.545,"5min":11.545,"15min":12.074999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.8580000000000001,"5min":0.85299999999999998,"15min":0.89500000000000002},"min":{"1min":0.251,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":11.577999999999999,"5min":11.577999999999999,"15min":12.269},"last":0.23999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739156,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6232440,"kb_used_data":4883952,"kb_used_omap":377,"kb_used_meta":1348102,"kb_avail":88139400,"statfs":{"total":96636764160,"available":90254745600,"internally_reserved":0,"allocated":5001166848,"data_stored":6347962124,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":1380457229},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,1,5,4,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.8169999999999999,"15min":1.6319999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":8.7569999999999997,"5min":21.207000000000001,"15min":21.207000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.153,"5min":0.68200000000000005,"15min":0.73199999999999998},"min":{"1min":0.22500000000000001,"5min":0.20300000000000001,"15min":0.19800000000000001},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":14.468},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.84599999999999997},"min":{"1min":0.193,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":4.0810000000000004,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.1120000000000001,"15min":0.83999999999999997},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":20.491,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.29899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5001420800,"data_stored":6348072466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7938834432,"data_stored":10063842091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2937757696,"data_stored":3716113689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:22:32.428 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:22:33.251 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:22:33.252 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:22:33.343 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2052,"stamp":"2023-09-23T08:22:32.223734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22452219211,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":1959359,"num_read_kb":7684882,"num_write":1938648,"num_write_kb":7754963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80352,"ondisk_log_size":80352,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20104864,"kb_used_data":15504712,"kb_used_omap":1200,"kb_used_meta":4598927,"kb_avail":263010656,"statfs":{"total":289910292480,"available":269322911744,"internally_reserved":0,"allocated":15876825088,"data_stored":20126738212,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1229219,"internal_metadata":4709301853},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,2,2,11,25,14,13,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16846848,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4771,"num_read_kb":18992,"num_write":4853,"num_write_kb":19412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001665"},"pg_stats":[{"pgid":"2.7","version":"79'240611","reported_seq":473023,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.149556+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:22:31.149556+0000","last_peered":"2023-09-23T08:22:31.149556+0000","last_clean":"2023-09-23T08:22:31.149556+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:22:31.149556+0000","last_undegraded":"2023-09-23T08:22:31.149556+0000","last_fullsized":"2023-09-23T08:22:31.149556+0000","mapping_epoch":13,"log_start":"76'230610","ondisk_log_start":"76'230610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:05:32.293565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2649526607,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":232277,"num_read_kb":911102,"num_write":229032,"num_write_kb":916032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"79'264078","reported_seq":519687,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.130447+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:22:31.130447+0000","last_peered":"2023-09-23T08:22:31.130447+0000","last_clean":"2023-09-23T08:22:31.130447+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:22:31.130447+0000","last_undegraded":"2023-09-23T08:22:31.130447+0000","last_fullsized":"2023-09-23T08:22:31.130447+0000","mapping_epoch":13,"log_start":"76'254007","ondisk_log_start":"76'254007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:30:29.542713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2950639935,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":256244,"num_read_kb":1001006,"num_write":252535,"num_write_kb":1009909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"79'251013","reported_seq":492693,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.140118+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:22:31.140118+0000","last_peered":"2023-09-23T08:22:31.140118+0000","last_clean":"2023-09-23T08:22:31.140118+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:22:31.140118+0000","last_undegraded":"2023-09-23T08:22:31.140118+0000","last_fullsized":"2023-09-23T08:22:31.140118+0000","mapping_epoch":13,"log_start":"76'241009","ondisk_log_start":"76'241009","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:42:21.202107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2756059436,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":241530,"num_read_kb":947305,"num_write":239457,"num_write_kb":957741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"79'254943","reported_seq":510406,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.129115+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:22:31.129115+0000","last_peered":"2023-09-23T08:22:31.129115+0000","last_clean":"2023-09-23T08:22:31.129115+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:22:31.129115+0000","last_undegraded":"2023-09-23T08:22:31.129115+0000","last_fullsized":"2023-09-23T08:22:31.129115+0000","mapping_epoch":13,"log_start":"76'244907","ondisk_log_start":"76'244907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:45:12.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2946265370,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":256123,"num_read_kb":1010563,"num_write":254155,"num_write_kb":1016533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"79'248424","reported_seq":496083,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:30.990820+0000","last_change":"2023-09-23T07:31:04.433973+0000","last_active":"2023-09-23T08:22:30.990820+0000","last_peered":"2023-09-23T08:22:30.990820+0000","last_clean":"2023-09-23T08:22:30.990820+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:22:30.990820+0000","last_undegraded":"2023-09-23T08:22:30.990820+0000","last_fullsized":"2023-09-23T08:22:30.990820+0000","mapping_epoch":13,"log_start":"76'238407","ondisk_log_start":"76'238407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:17:37.031069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2841981246,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":247869,"num_read_kb":972463,"num_write":246081,"num_write_kb":984174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"79'256914","reported_seq":510493,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.810342+0000","last_change":"2023-09-23T07:31:04.563014+0000","last_active":"2023-09-23T08:22:31.810342+0000","last_peered":"2023-09-23T08:22:31.810342+0000","last_clean":"2023-09-23T08:22:31.810342+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:22:31.810342+0000","last_undegraded":"2023-09-23T08:22:31.810342+0000","last_fullsized":"2023-09-23T08:22:31.810342+0000","mapping_epoch":13,"log_start":"76'246911","ondisk_log_start":"76'246911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:23:49.806180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2926395862,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":253610,"num_read_kb":994096,"num_write":251618,"num_write_kb":1006352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"79'234749","reported_seq":466900,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.793797+0000","last_change":"2023-09-23T07:31:04.436558+0000","last_active":"2023-09-23T08:22:31.793797+0000","last_peered":"2023-09-23T08:22:31.793797+0000","last_clean":"2023-09-23T08:22:31.793797+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:22:31.793797+0000","last_undegraded":"2023-09-23T08:22:31.793797+0000","last_fullsized":"2023-09-23T08:22:31.793797+0000","mapping_epoch":13,"log_start":"76'224707","ondisk_log_start":"76'224707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:54:10.667393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2655633709,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":231954,"num_read_kb":909241,"num_write":229534,"num_write_kb":918049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"79'247685","reported_seq":487369,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.135137+0000","last_change":"2023-09-23T07:31:06.964056+0000","last_active":"2023-09-23T08:22:31.135137+0000","last_peered":"2023-09-23T08:22:31.135137+0000","last_clean":"2023-09-23T08:22:31.135137+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:22:31.135137+0000","last_undegraded":"2023-09-23T08:22:31.135137+0000","last_fullsized":"2023-09-23T08:22:31.135137+0000","mapping_epoch":13,"log_start":"76'237604","ondisk_log_start":"76'237604","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T07:58:45.409451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2725126678,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":239646,"num_read_kb":939015,"num_write":236099,"num_write_kb":944279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":237,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-09-23T08:22:10.500898+0000","last_change":"2023-09-23T07:16:44.817065+0000","last_active":"2023-09-23T08:22:10.500898+0000","last_peered":"2023-09-23T08:22:10.500898+0000","last_clean":"2023-09-23T08:22:10.500898+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:22:10.500898+0000","last_undegraded":"2023-09-23T08:22:10.500898+0000","last_fullsized":"2023-09-23T08:22:10.500898+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_clean_scrub_stamp":"2023-09-23T07:16:43.255638+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:01:32.785546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22451628843,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":1959253,"num_read_kb":7684791,"num_write":1938511,"num_write_kb":7753069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15878012928,"data_stored":20128028246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80255,"ondisk_log_size":80255,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739160,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4254808,"kb_used_data":2869264,"kb_used_omap":219,"kb_used_meta":1385316,"kb_avail":90117032,"statfs":{"total":96636764160,"available":92279840768,"internally_reserved":0,"allocated":2938126336,"data_stored":3716092915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1418564429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,0,1,4,5,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85299999999999998,"15min":0.60299999999999998},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":8.2270000000000003,"5min":8.2270000000000003,"15min":8.2270000000000003},"last":0.217},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.087,"15min":0.98499999999999999},"min":{"1min":0.22500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":8.2629999999999999,"5min":8.2629999999999999,"15min":25.483000000000001},"last":4.2750000000000004}]},{"osd":1,"last update":"Sat Sep 23 08:21:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.95399999999999996,"15min":0.78700000000000003},"min":{"1min":0.219,"5min":0.215,"15min":0.215},"max":{"1min":11.65,"5min":11.65,"15min":25.550000000000001},"last":0.307},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85799999999999998,"15min":0.76700000000000002},"min":{"1min":0.224,"5min":0.182,"15min":0.182},"max":{"1min":5.875,"5min":7.0350000000000001,"15min":8.125},"last":0.436}]}]},{"osd":1,"up_from":8,"seq":34359739150,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9617616,"kb_used_data":7751496,"kb_used_omap":603,"kb_used_meta":1865508,"kb_avail":84754224,"statfs":{"total":96636764160,"available":86788325376,"internally_reserved":0,"allocated":7937531904,"data_stored":10062683173,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":618493,"internal_metadata":1910280195},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,0,9,16,5,5,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":0.84599999999999997,"15min":0.73199999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":10.25,"5min":10.25,"15min":10.25},"last":0.27200000000000002},{"interface":"front","average":{"1min":1.234,"5min":0.89700000000000002,"15min":0.77900000000000003},"min":{"1min":0.187,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.665,"5min":7.5410000000000004,"15min":9.8849999999999998},"last":0.36099999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":0.996,"15min":0.88600000000000001},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":11.545,"5min":11.545,"15min":12.074999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.8580000000000001,"5min":0.85299999999999998,"15min":0.89500000000000002},"min":{"1min":0.251,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":11.577999999999999,"5min":11.577999999999999,"15min":12.269},"last":0.23999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739156,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6232440,"kb_used_data":4883952,"kb_used_omap":377,"kb_used_meta":1348102,"kb_avail":88139400,"statfs":{"total":96636764160,"available":90254745600,"internally_reserved":0,"allocated":5001166848,"data_stored":6347962124,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":1380457229},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,1,5,4,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.8169999999999999,"15min":1.6319999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":8.7569999999999997,"5min":21.207000000000001,"15min":21.207000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.153,"5min":0.68200000000000005,"15min":0.73199999999999998},"min":{"1min":0.22500000000000001,"5min":0.20300000000000001,"15min":0.19800000000000001},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":14.468},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.84599999999999997},"min":{"1min":0.193,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":4.0810000000000004,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.1120000000000001,"15min":0.83999999999999997},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":20.491,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.29899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5001420800,"data_stored":6348072466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7938834432,"data_stored":10063842091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2937757696,"data_stored":3716113689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:22:33.344 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-23T08:22:33.345 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:22:34.082 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:22:34.083 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:22:34.144 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2052,"stamp":"2023-09-23T08:22:32.223734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22452219211,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":1959359,"num_read_kb":7684882,"num_write":1938648,"num_write_kb":7754963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80352,"ondisk_log_size":80352,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20104864,"kb_used_data":15504712,"kb_used_omap":1200,"kb_used_meta":4598927,"kb_avail":263010656,"statfs":{"total":289910292480,"available":269322911744,"internally_reserved":0,"allocated":15876825088,"data_stored":20126738212,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1229219,"internal_metadata":4709301853},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,2,2,11,25,14,13,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16846848,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4771,"num_read_kb":18992,"num_write":4853,"num_write_kb":19412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001665"},"pg_stats":[{"pgid":"2.7","version":"79'240611","reported_seq":473023,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.149556+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:22:31.149556+0000","last_peered":"2023-09-23T08:22:31.149556+0000","last_clean":"2023-09-23T08:22:31.149556+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:22:31.149556+0000","last_undegraded":"2023-09-23T08:22:31.149556+0000","last_fullsized":"2023-09-23T08:22:31.149556+0000","mapping_epoch":13,"log_start":"76'230610","ondisk_log_start":"76'230610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:05:32.293565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2649526607,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":232277,"num_read_kb":911102,"num_write":229032,"num_write_kb":916032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"79'264078","reported_seq":519687,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.130447+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:22:31.130447+0000","last_peered":"2023-09-23T08:22:31.130447+0000","last_clean":"2023-09-23T08:22:31.130447+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:22:31.130447+0000","last_undegraded":"2023-09-23T08:22:31.130447+0000","last_fullsized":"2023-09-23T08:22:31.130447+0000","mapping_epoch":13,"log_start":"76'254007","ondisk_log_start":"76'254007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:30:29.542713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2950639935,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":256244,"num_read_kb":1001006,"num_write":252535,"num_write_kb":1009909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"79'251013","reported_seq":492693,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.140118+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:22:31.140118+0000","last_peered":"2023-09-23T08:22:31.140118+0000","last_clean":"2023-09-23T08:22:31.140118+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:22:31.140118+0000","last_undegraded":"2023-09-23T08:22:31.140118+0000","last_fullsized":"2023-09-23T08:22:31.140118+0000","mapping_epoch":13,"log_start":"76'241009","ondisk_log_start":"76'241009","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:42:21.202107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2756059436,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":241530,"num_read_kb":947305,"num_write":239457,"num_write_kb":957741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"79'254943","reported_seq":510406,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.129115+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:22:31.129115+0000","last_peered":"2023-09-23T08:22:31.129115+0000","last_clean":"2023-09-23T08:22:31.129115+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:22:31.129115+0000","last_undegraded":"2023-09-23T08:22:31.129115+0000","last_fullsized":"2023-09-23T08:22:31.129115+0000","mapping_epoch":13,"log_start":"76'244907","ondisk_log_start":"76'244907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:45:12.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2946265370,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":256123,"num_read_kb":1010563,"num_write":254155,"num_write_kb":1016533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"79'248424","reported_seq":496083,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:30.990820+0000","last_change":"2023-09-23T07:31:04.433973+0000","last_active":"2023-09-23T08:22:30.990820+0000","last_peered":"2023-09-23T08:22:30.990820+0000","last_clean":"2023-09-23T08:22:30.990820+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:22:30.990820+0000","last_undegraded":"2023-09-23T08:22:30.990820+0000","last_fullsized":"2023-09-23T08:22:30.990820+0000","mapping_epoch":13,"log_start":"76'238407","ondisk_log_start":"76'238407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:17:37.031069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2841981246,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":247869,"num_read_kb":972463,"num_write":246081,"num_write_kb":984174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"79'256914","reported_seq":510493,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.810342+0000","last_change":"2023-09-23T07:31:04.563014+0000","last_active":"2023-09-23T08:22:31.810342+0000","last_peered":"2023-09-23T08:22:31.810342+0000","last_clean":"2023-09-23T08:22:31.810342+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:22:31.810342+0000","last_undegraded":"2023-09-23T08:22:31.810342+0000","last_fullsized":"2023-09-23T08:22:31.810342+0000","mapping_epoch":13,"log_start":"76'246911","ondisk_log_start":"76'246911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:23:49.806180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2926395862,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":253610,"num_read_kb":994096,"num_write":251618,"num_write_kb":1006352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"79'234749","reported_seq":466900,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.793797+0000","last_change":"2023-09-23T07:31:04.436558+0000","last_active":"2023-09-23T08:22:31.793797+0000","last_peered":"2023-09-23T08:22:31.793797+0000","last_clean":"2023-09-23T08:22:31.793797+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:22:31.793797+0000","last_undegraded":"2023-09-23T08:22:31.793797+0000","last_fullsized":"2023-09-23T08:22:31.793797+0000","mapping_epoch":13,"log_start":"76'224707","ondisk_log_start":"76'224707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:54:10.667393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2655633709,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":231954,"num_read_kb":909241,"num_write":229534,"num_write_kb":918049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"79'247685","reported_seq":487369,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:31.135137+0000","last_change":"2023-09-23T07:31:06.964056+0000","last_active":"2023-09-23T08:22:31.135137+0000","last_peered":"2023-09-23T08:22:31.135137+0000","last_clean":"2023-09-23T08:22:31.135137+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:22:31.135137+0000","last_undegraded":"2023-09-23T08:22:31.135137+0000","last_fullsized":"2023-09-23T08:22:31.135137+0000","mapping_epoch":13,"log_start":"76'237604","ondisk_log_start":"76'237604","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T07:58:45.409451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2725126678,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":239646,"num_read_kb":939015,"num_write":236099,"num_write_kb":944279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":237,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-09-23T08:22:10.500898+0000","last_change":"2023-09-23T07:16:44.817065+0000","last_active":"2023-09-23T08:22:10.500898+0000","last_peered":"2023-09-23T08:22:10.500898+0000","last_clean":"2023-09-23T08:22:10.500898+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:22:10.500898+0000","last_undegraded":"2023-09-23T08:22:10.500898+0000","last_fullsized":"2023-09-23T08:22:10.500898+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_clean_scrub_stamp":"2023-09-23T07:16:43.255638+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:01:32.785546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22451628843,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":1959253,"num_read_kb":7684791,"num_write":1938511,"num_write_kb":7753069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15878012928,"data_stored":20128028246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80255,"ondisk_log_size":80255,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739160,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4254808,"kb_used_data":2869264,"kb_used_omap":219,"kb_used_meta":1385316,"kb_avail":90117032,"statfs":{"total":96636764160,"available":92279840768,"internally_reserved":0,"allocated":2938126336,"data_stored":3716092915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1418564429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,0,1,4,5,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85299999999999998,"15min":0.60299999999999998},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":8.2270000000000003,"5min":8.2270000000000003,"15min":8.2270000000000003},"last":0.217},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.087,"15min":0.98499999999999999},"min":{"1min":0.22500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":8.2629999999999999,"5min":8.2629999999999999,"15min":25.483000000000001},"last":4.2750000000000004}]},{"osd":1,"last update":"Sat Sep 23 08:21:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.95399999999999996,"15min":0.78700000000000003},"min":{"1min":0.219,"5min":0.215,"15min":0.215},"max":{"1min":11.65,"5min":11.65,"15min":25.550000000000001},"last":0.307},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85799999999999998,"15min":0.76700000000000002},"min":{"1min":0.224,"5min":0.182,"15min":0.182},"max":{"1min":5.875,"5min":7.0350000000000001,"15min":8.125},"last":0.436}]}]},{"osd":1,"up_from":8,"seq":34359739150,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9617616,"kb_used_data":7751496,"kb_used_omap":603,"kb_used_meta":1865508,"kb_avail":84754224,"statfs":{"total":96636764160,"available":86788325376,"internally_reserved":0,"allocated":7937531904,"data_stored":10062683173,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":618493,"internal_metadata":1910280195},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,0,9,16,5,5,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":0.84599999999999997,"15min":0.73199999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":10.25,"5min":10.25,"15min":10.25},"last":0.27200000000000002},{"interface":"front","average":{"1min":1.234,"5min":0.89700000000000002,"15min":0.77900000000000003},"min":{"1min":0.187,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.665,"5min":7.5410000000000004,"15min":9.8849999999999998},"last":0.36099999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":0.996,"15min":0.88600000000000001},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":11.545,"5min":11.545,"15min":12.074999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.8580000000000001,"5min":0.85299999999999998,"15min":0.89500000000000002},"min":{"1min":0.251,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":11.577999999999999,"5min":11.577999999999999,"15min":12.269},"last":0.23999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739156,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6232440,"kb_used_data":4883952,"kb_used_omap":377,"kb_used_meta":1348102,"kb_avail":88139400,"statfs":{"total":96636764160,"available":90254745600,"internally_reserved":0,"allocated":5001166848,"data_stored":6347962124,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":1380457229},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,1,5,4,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.8169999999999999,"15min":1.6319999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":8.7569999999999997,"5min":21.207000000000001,"15min":21.207000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.153,"5min":0.68200000000000005,"15min":0.73199999999999998},"min":{"1min":0.22500000000000001,"5min":0.20300000000000001,"15min":0.19800000000000001},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":14.468},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.84599999999999997},"min":{"1min":0.193,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":4.0810000000000004,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.1120000000000001,"15min":0.83999999999999997},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":20.491,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.29899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5001420800,"data_stored":6348072466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7938834432,"data_stored":10063842091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2937757696,"data_stored":3716113689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:22:34.146 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-23T08:22:34.792 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:22:34.792 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":79,"fsid":"0225e296-dc9b-41de-b54f-a70821d0cf5c","created":"2023-09-23T07:16:30.251208+0000","modified":"2023-09-23T08:22:26.823942+0000","last_up_change":"2023-09-23T07:16:41.250301+0000","last_in_change":"2023-09-23T07:16:31.153990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-23T07:16:43.129545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-23T07:16:45.469478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":73,"snap_epoch":69,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"281c78ca-bc94-413f-90c5-069cbe97fa37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6801","nonce":2734954741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6803","nonce":2734954741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6807","nonce":2734954741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2734954741},{"type":"v1","addr":"172.21.15.107:6805","nonce":2734954741}]},"public_addr":"172.21.15.107:6801/2734954741","cluster_addr":"172.21.15.107:6803/2734954741","heartbeat_back_addr":"172.21.15.107:6807/2734954741","heartbeat_front_addr":"172.21.15.107:6805/2734954741","state":["exists","up"]},{"osd":1,"uuid":"4cdbf0c8-ab19-4c5f-acd3-a642e52ea2b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6809","nonce":1741437062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6811","nonce":1741437062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6815","nonce":1741437062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1741437062},{"type":"v1","addr":"172.21.15.107:6813","nonce":1741437062}]},"public_addr":"172.21.15.107:6809/1741437062","cluster_addr":"172.21.15.107:6811/1741437062","heartbeat_back_addr":"172.21.15.107:6815/1741437062","heartbeat_front_addr":"172.21.15.107:6813/1741437062","state":["exists","up"]},{"osd":2,"uuid":"c75f2c99-285f-45a4-9f03-df7b3547bbaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6817","nonce":3526584739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6819","nonce":3526584739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6823","nonce":3526584739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3526584739},{"type":"v1","addr":"172.21.15.107:6821","nonce":3526584739}]},"public_addr":"172.21.15.107:6817/3526584739","cluster_addr":"172.21.15.107:6819/3526584739","heartbeat_back_addr":"172.21.15.107:6823/3526584739","heartbeat_front_addr":"172.21.15.107:6821/3526584739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.675027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.761285+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-23T07:16:36.823646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/1631903394":"2023-09-23T08:33:28.397037+0000","172.21.15.107:0/82994300":"2023-09-23T08:24:50.348558+0000","172.21.15.107:0/3794664142":"2023-09-23T08:27:14.581115+0000","172.21.15.107:0/3331528018":"2023-09-23T08:31:03.142762+0000","172.21.15.107:0/3525840987":"2023-09-23T08:32:15.009939+0000","172.21.15.107:0/2539479216":"2023-09-23T08:26:02.661392+0000","172.21.15.107:0/520668625":"2023-09-23T08:23:38.305973+0000","172.21.15.107:0/1403882201":"2023-09-23T08:28:38.506594+0000","172.21.15.107:0/4281073538":"2023-09-23T08:29:51.402625+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-23T08:22:35.865 INFO:tasks.ceph:Scrubbing osd.0 2023-09-23T08:22:35.865 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-23T08:22:36.231 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-09-23T08:22:36.232 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-23T08:22:36.232 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-09-23T08:22:36.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-23T08:22:37.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:37.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:37.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:37.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:37.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:37.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:37.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:37.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:37.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:37.171 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 0 to deep-scrub 2023-09-23T08:22:37.247 INFO:tasks.ceph:Scrubbing osd.1 2023-09-23T08:22:37.247 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-23T08:22:37.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:37.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:37.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:37.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:37.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:37.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:37.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:37.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:37.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:37.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:37.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:37.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:37.559 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-09-23T08:22:37.559 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-23T08:22:37.559 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-09-23T08:22:37.583 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-23T08:22:37.978 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 1 to deep-scrub 2023-09-23T08:22:38.055 INFO:tasks.ceph:Scrubbing osd.2 2023-09-23T08:22:38.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-23T08:22:38.386 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-09-23T08:22:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-23T08:22:38.387 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-09-23T08:22:38.426 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-23T08:22:39.229 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 2 to deep-scrub 2023-09-23T08:22:39.268 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:22:39.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:39.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:39.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:39.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:39.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:39.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:39.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:39.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:39.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:39.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:39.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:39.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:39.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:39.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:39.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:39.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:39.667 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:22:39.668 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:22:39.695 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2055,"stamp":"2023-09-23T08:22:38.224668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22460243275,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":1961646,"num_read_kb":7694002,"num_write":1940985,"num_write_kb":7764311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80503,"ondisk_log_size":80503,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20191804,"kb_used_data":15525024,"kb_used_omap":1200,"kb_used_meta":4665551,"kb_avail":262923716,"statfs":{"total":289910292480,"available":269233885184,"internally_reserved":0,"allocated":15897624576,"data_stored":20147537700,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1229219,"internal_metadata":4777524829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,6,7,7,11,13,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16486400,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4691,"num_read_kb":18684,"num_write":4768,"num_write_kb":19072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.396190"},"pg_stats":[{"pgid":"2.7","version":"79'240902","reported_seq":473605,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:36.267645+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:22:36.267645+0000","last_peered":"2023-09-23T08:22:36.267645+0000","last_clean":"2023-09-23T08:22:36.267645+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:22:36.267645+0000","last_undegraded":"2023-09-23T08:22:36.267645+0000","last_fullsized":"2023-09-23T08:22:36.267645+0000","mapping_epoch":13,"log_start":"76'230810","ondisk_log_start":"76'230810","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:05:32.293565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2650521935,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":232567,"num_read_kb":912262,"num_write":229320,"num_write_kb":917184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"79'264399","reported_seq":520335,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:36.255692+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:22:36.255692+0000","last_peered":"2023-09-23T08:22:36.255692+0000","last_clean":"2023-09-23T08:22:36.255692+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:22:36.255692+0000","last_undegraded":"2023-09-23T08:22:36.255692+0000","last_fullsized":"2023-09-23T08:22:36.255692+0000","mapping_epoch":13,"log_start":"76'254307","ondisk_log_start":"76'254307","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:30:29.542713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2951696703,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":256571,"num_read_kb":1002310,"num_write":252853,"num_write_kb":1011181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"79'251272","reported_seq":493227,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:36.236044+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:22:36.236044+0000","last_peered":"2023-09-23T08:22:36.236044+0000","last_clean":"2023-09-23T08:22:36.236044+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:22:36.236044+0000","last_undegraded":"2023-09-23T08:22:36.236044+0000","last_fullsized":"2023-09-23T08:22:36.236044+0000","mapping_epoch":13,"log_start":"76'241209","ondisk_log_start":"76'241209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T18:42:21.202107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2756944172,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":241802,"num_read_kb":948389,"num_write":239713,"num_write_kb":958765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"79'255261","reported_seq":511031,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:36.230236+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:22:36.230236+0000","last_peered":"2023-09-23T08:22:36.230236+0000","last_clean":"2023-09-23T08:22:36.230236+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:22:36.230236+0000","last_undegraded":"2023-09-23T08:22:36.230236+0000","last_fullsized":"2023-09-23T08:22:36.230236+0000","mapping_epoch":13,"log_start":"76'245207","ondisk_log_start":"76'245207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:45:12.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2947387674,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":256425,"num_read_kb":1011767,"num_write":254473,"num_write_kb":1017805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"79'248713","reported_seq":496641,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:35.999340+0000","last_change":"2023-09-23T07:31:04.433973+0000","last_active":"2023-09-23T08:22:35.999340+0000","last_peered":"2023-09-23T08:22:35.999340+0000","last_clean":"2023-09-23T08:22:35.999340+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:22:35.999340+0000","last_undegraded":"2023-09-23T08:22:35.999340+0000","last_fullsized":"2023-09-23T08:22:35.999340+0000","mapping_epoch":13,"log_start":"76'238707","ondisk_log_start":"76'238707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:17:37.031069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2842972478,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":248137,"num_read_kb":973531,"num_write":246368,"num_write_kb":985322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"79'257213","reported_seq":511075,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:36.877187+0000","last_change":"2023-09-23T07:31:04.563014+0000","last_active":"2023-09-23T08:22:36.877187+0000","last_peered":"2023-09-23T08:22:36.877187+0000","last_clean":"2023-09-23T08:22:36.877187+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:22:36.877187+0000","last_undegraded":"2023-09-23T08:22:36.877187+0000","last_fullsized":"2023-09-23T08:22:36.877187+0000","mapping_epoch":13,"log_start":"76'247211","ondisk_log_start":"76'247211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T08:23:49.806180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2927473110,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":253898,"num_read_kb":995248,"num_write":251917,"num_write_kb":1007548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"79'235021","reported_seq":467443,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:36.868974+0000","last_change":"2023-09-23T07:31:04.436558+0000","last_active":"2023-09-23T08:22:36.868974+0000","last_peered":"2023-09-23T08:22:36.868974+0000","last_clean":"2023-09-23T08:22:36.868974+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:22:36.868974+0000","last_undegraded":"2023-09-23T08:22:36.868974+0000","last_fullsized":"2023-09-23T08:22:36.868974+0000","mapping_epoch":13,"log_start":"76'225007","ondisk_log_start":"76'225007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:54:10.667393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2656526637,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":232223,"num_read_kb":910313,"num_write":229806,"num_write_kb":919137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"79'247987","reported_seq":487941,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:36.240244+0000","last_change":"2023-09-23T07:31:06.964056+0000","last_active":"2023-09-23T08:22:36.240244+0000","last_peered":"2023-09-23T08:22:36.240244+0000","last_clean":"2023-09-23T08:22:36.240244+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:22:36.240244+0000","last_undegraded":"2023-09-23T08:22:36.240244+0000","last_fullsized":"2023-09-23T08:22:36.240244+0000","mapping_epoch":13,"log_start":"76'237904","ondisk_log_start":"76'237904","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T07:58:45.409451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2726130198,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":239917,"num_read_kb":940091,"num_write":236398,"num_write_kb":945475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":237,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-09-23T08:22:10.500898+0000","last_change":"2023-09-23T07:16:44.817065+0000","last_active":"2023-09-23T08:22:10.500898+0000","last_peered":"2023-09-23T08:22:10.500898+0000","last_clean":"2023-09-23T08:22:10.500898+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:22:10.500898+0000","last_undegraded":"2023-09-23T08:22:10.500898+0000","last_fullsized":"2023-09-23T08:22:10.500898+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:43.255638+0000","last_clean_scrub_stamp":"2023-09-23T07:16:43.255638+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T10:01:32.785546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22459652907,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":1961540,"num_read_kb":7693911,"num_write":1940848,"num_write_kb":7762417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15897071616,"data_stored":20147086934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80406,"ondisk_log_size":80406,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739161,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4258316,"kb_used_data":2872772,"kb_used_omap":219,"kb_used_meta":1385316,"kb_avail":90113524,"statfs":{"total":96636764160,"available":92276248576,"internally_reserved":0,"allocated":2941718528,"data_stored":3719685107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1418564429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85299999999999998,"15min":0.60299999999999998},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":8.2270000000000003,"5min":8.2270000000000003,"15min":8.2270000000000003},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.087,"15min":0.98499999999999999},"min":{"1min":0.22500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":8.2629999999999999,"5min":8.2629999999999999,"15min":25.483000000000001},"last":1.5509999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:21:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.95399999999999996,"15min":0.78700000000000003},"min":{"1min":0.219,"5min":0.215,"15min":0.215},"max":{"1min":11.65,"5min":11.65,"15min":25.550000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85799999999999998,"15min":0.76700000000000002},"min":{"1min":0.224,"5min":0.182,"15min":0.182},"max":{"1min":5.875,"5min":7.0350000000000001,"15min":8.125},"last":0.25900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739151,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9691304,"kb_used_data":7762716,"kb_used_omap":603,"kb_used_meta":1927972,"kb_avail":84680536,"statfs":{"total":96636764160,"available":86712868864,"internally_reserved":0,"allocated":7949021184,"data_stored":10074172453,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":618493,"internal_metadata":1974243331},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,6,4,4,8,7,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":0.84599999999999997,"15min":0.73199999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.191},"max":{"1min":10.25,"5min":10.25,"15min":10.25},"last":0.308},{"interface":"front","average":{"1min":1.234,"5min":0.89700000000000002,"15min":0.77900000000000003},"min":{"1min":0.187,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.665,"5min":7.5410000000000004,"15min":9.8849999999999998},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":0.996,"15min":0.88600000000000001},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":11.545,"5min":11.545,"15min":12.074999999999999},"last":0.441},{"interface":"front","average":{"1min":1.8580000000000001,"5min":0.85299999999999998,"15min":0.89500000000000002},"min":{"1min":0.251,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":11.577999999999999,"5min":11.577999999999999,"15min":12.269},"last":0.27700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739157,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6242184,"kb_used_data":4889536,"kb_used_omap":377,"kb_used_meta":1352262,"kb_avail":88129656,"statfs":{"total":96636764160,"available":90244767744,"internally_reserved":0,"allocated":5006884864,"data_stored":6353680140,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":1384717069},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,0,2,4,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:21:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.8169999999999999,"15min":1.6319999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":8.7569999999999997,"5min":21.207000000000001,"15min":21.207000000000001},"last":0.20799999999999999},{"interface":"front","average":{"1min":1.153,"5min":0.68200000000000005,"15min":0.73199999999999998},"min":{"1min":0.22500000000000001,"5min":0.20300000000000001,"15min":0.19800000000000001},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":14.468},"last":0.26100000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.84599999999999997},"min":{"1min":0.193,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":4.0810000000000004,"5min":15.039999999999999,"15min":15.039999999999999},"last":9.0150000000000006},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.1120000000000001,"15min":0.83999999999999997},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":20.491,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.23699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5007310848,"data_stored":6353962514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7948464128,"data_stored":10073471787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2941296640,"data_stored":3719652633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:22:39.698 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:22:39.698 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:22:39.698 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:22:39.698 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:22:39.698 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:22:39.699 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:22:39.699 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:22:39.699 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:22:39.699 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-23T07:16:43.255638+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=43, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:22:39.699 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:22:40.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:40.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:40.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:40.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:40.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:40.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:40.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:40.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:40.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:40.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:40.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:40.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:41.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:41.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:41.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:41.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:41.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:41.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:41.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:41.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:41.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:41.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:41.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:41.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:41.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:42.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:42.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:42.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:42.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:42.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:42.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:42.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:42.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:42.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:42.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:42.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:42.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:42.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:42.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:44.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:44.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:44.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:44.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:44.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:44.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:44.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:44.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:44.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:44.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:44.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:44.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:44.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:44.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:44.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:44.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:47.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:47.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:47.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:47.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:47.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:47.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:47.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:47.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:47.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:47.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:47.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:47.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:47.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:47.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:49.192 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:49.188+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:22:49.193 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:49.188+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:22:49.193 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:49.188+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:22:50.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:50.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:50.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:50.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:50.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:50.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:50.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:50.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:50.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:50.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:50.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:50.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:50.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:50.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:50.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:50.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:50.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:50.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:50.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:50.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:51.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:51.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:51.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:51.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:51.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:51.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:51.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:51.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:51.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:51.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:51.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:51.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:51.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:51.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:51.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:51.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:51.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:51.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:54.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:54.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:54.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:54.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:54.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:54.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:54.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:54.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:54.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:54.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:54.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:54.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:54.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:54.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:54.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:54.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:54.753 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:54.748+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:22:54.753 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:54.748+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:22:54.780 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:54.776+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:22:54.780 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:54.776+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:22:54.780 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:22:54.776+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:22:54.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:54.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:54.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:54.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:54.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:55.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:55.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:55.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:55.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:55.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:55.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:55.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:55.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:55.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:55.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:55.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:55.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:55.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:55.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:55.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:57.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:57.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:57.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:57.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:57.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:57.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:57.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:57.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:57.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:57.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:57.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:57.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:57.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:57.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:57.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:57.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:57.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:57.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:57.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:57.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:57.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:57.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:57.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:57.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:57.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:22:57.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:57.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:57.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:57.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:57.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:57.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:57.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:57.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:57.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:57.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:57.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:57.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:58.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:22:58.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:22:58.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:22:58.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:22:58.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:22:58.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:22:58.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:58.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:58.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:58.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:22:58.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:58.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:22:59.701 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:22:59.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:59.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:22:59.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:59.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:22:59.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:59.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:22:59.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:22:59.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:00.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:23:00.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:00.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:00.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:00.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:00.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:00.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:00.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:00.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:00.637 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:23:00.637 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:23:00.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:00.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:00.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:00.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:00.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:00.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:00.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:00.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:00.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:00.715 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2066,"stamp":"2023-09-23T08:23:00.232771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22488730955,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":1969961,"num_read_kb":7727174,"num_write":1949211,"num_write_kb":7797215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80534,"ondisk_log_size":80534,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20513620,"kb_used_data":15589880,"kb_used_omap":1200,"kb_used_meta":4922511,"kb_avail":262601900,"statfs":{"total":289910292480,"available":268904345600,"internally_reserved":0,"allocated":15964037120,"data_stored":20213950244,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1229219,"internal_metadata":5040651869},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,3,9,10,8,17],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14745600,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4304,"num_read_kb":17168,"num_write":4256,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006070"},"pg_stats":[{"pgid":"2.7","version":"79'241962","reported_seq":475725,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:57.347260+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:22:57.347260+0000","last_peered":"2023-09-23T08:22:57.347260+0000","last_clean":"2023-09-23T08:22:57.347260+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:22:57.347260+0000","last_undegraded":"2023-09-23T08:22:57.347260+0000","last_fullsized":"2023-09-23T08:22:57.347260+0000","mapping_epoch":13,"log_start":"77'231910","ondisk_log_start":"77'231910","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2654011727,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":233616,"num_read_kb":916450,"num_write":230330,"num_write_kb":921224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"79'265524","reported_seq":522572,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:57.315750+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:22:57.315750+0000","last_peered":"2023-09-23T08:22:57.315750+0000","last_clean":"2023-09-23T08:22:57.315750+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:22:57.315750+0000","last_undegraded":"2023-09-23T08:22:57.315750+0000","last_fullsized":"2023-09-23T08:22:57.315750+0000","mapping_epoch":13,"log_start":"77'255507","ondisk_log_start":"77'255507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2955534655,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":257670,"num_read_kb":1006690,"num_write":253927,"num_write_kb":1015477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"79'252347","reported_seq":495379,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:57.295409+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:22:57.295409+0000","last_peered":"2023-09-23T08:22:57.295409+0000","last_clean":"2023-09-23T08:22:57.295409+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:22:57.295409+0000","last_undegraded":"2023-09-23T08:22:57.295409+0000","last_fullsized":"2023-09-23T08:22:57.295409+0000","mapping_epoch":13,"log_start":"77'242309","ondisk_log_start":"77'242309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2760491308,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":242873,"num_read_kb":952665,"num_write":240738,"num_write_kb":962865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"79'256388","reported_seq":513314,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:57.260545+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:22:57.260545+0000","last_peered":"2023-09-23T08:22:57.260545+0000","last_clean":"2023-09-23T08:22:57.260545+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:22:57.260545+0000","last_undegraded":"2023-09-23T08:22:57.260545+0000","last_fullsized":"2023-09-23T08:22:57.260545+0000","mapping_epoch":13,"log_start":"77'246307","ondisk_log_start":"77'246307","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2951221530,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":257577,"num_read_kb":1016359,"num_write":255600,"num_write_kb":1022313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"79'249707","reported_seq":498624,"reported_epoch":79,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:22:56.121850+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:22:56.121850+0000","last_peered":"2023-09-23T08:22:56.121850+0000","last_clean":"2023-09-23T08:22:56.121850+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:22:56.121850+0000","last_undegraded":"2023-09-23T08:22:56.121850+0000","last_fullsized":"2023-09-23T08:22:56.121850+0000","mapping_epoch":13,"log_start":"76'239607","ondisk_log_start":"76'239607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":73,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 18s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2846253374,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":249110,"num_read_kb":977407,"num_write":247313,"num_write_kb":989102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"79'258285","reported_seq":513154,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:57.017638+0000","last_change":"2023-09-23T08:22:55.740982+0000","last_active":"2023-09-23T08:22:57.017638+0000","last_peered":"2023-09-23T08:22:57.017638+0000","last_clean":"2023-09-23T08:22:57.017638+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:22:57.017638+0000","last_undegraded":"2023-09-23T08:22:57.017638+0000","last_fullsized":"2023-09-23T08:22:57.017638+0000","mapping_epoch":13,"log_start":"77'248211","ondisk_log_start":"77'248211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2931179990,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":254877,"num_read_kb":999164,"num_write":252980,"num_write_kb":1011800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"79'236029","reported_seq":469462,"reported_epoch":79,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:22:56.972247+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:22:56.972247+0000","last_peered":"2023-09-23T08:22:56.972247+0000","last_clean":"2023-09-23T08:22:56.972247+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:22:56.972247+0000","last_undegraded":"2023-09-23T08:22:56.972247+0000","last_fullsized":"2023-09-23T08:22:56.972247+0000","mapping_epoch":13,"log_start":"76'226007","ondisk_log_start":"76'226007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":48,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 16s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2659860781,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":233211,"num_read_kb":914253,"num_write":230773,"num_write_kb":923005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"79'249055","reported_seq":490031,"reported_epoch":79,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:22:57.283941+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:22:57.283941+0000","last_peered":"2023-09-23T08:22:57.283941+0000","last_clean":"2023-09-23T08:22:57.283941+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:22:57.283941+0000","last_undegraded":"2023-09-23T08:22:57.283941+0000","last_fullsized":"2023-09-23T08:22:57.283941+0000","mapping_epoch":13,"log_start":"77'239004","ondisk_log_start":"77'239004","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":13,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 16s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2729587222,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":240921,"num_read_kb":944095,"num_write":237413,"num_write_kb":949535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:40.293031+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:22:40.293031+0000","last_peered":"2023-09-23T08:22:40.293031+0000","last_clean":"2023-09-23T08:22:40.293031+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:22:40.293031+0000","last_undegraded":"2023-09-23T08:22:40.293031+0000","last_fullsized":"2023-09-23T08:22:40.293031+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22488140587,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":1969855,"num_read_kb":7727083,"num_write":1949074,"num_write_kb":7795321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15963987968,"data_stored":20214003286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80435,"ondisk_log_size":80435,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739165,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4338200,"kb_used_data":2884688,"kb_used_omap":219,"kb_used_meta":1453284,"kb_avail":90033640,"statfs":{"total":96636764160,"available":92194447360,"internally_reserved":0,"allocated":2953920512,"data_stored":3731887091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1488163661},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85299999999999998,"15min":0.60299999999999998},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":8.2270000000000003,"5min":8.2270000000000003,"15min":8.2270000000000003},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.087,"15min":0.98499999999999999},"min":{"1min":0.22500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":8.2629999999999999,"5min":8.2629999999999999,"15min":25.483000000000001},"last":0.25600000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:21:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.95399999999999996,"15min":0.78700000000000003},"min":{"1min":0.219,"5min":0.215,"15min":0.215},"max":{"1min":11.65,"5min":11.65,"15min":25.550000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85799999999999998,"15min":0.76700000000000002},"min":{"1min":0.224,"5min":0.182,"15min":0.182},"max":{"1min":5.875,"5min":7.0350000000000001,"15min":8.125},"last":2.698}]}]},{"osd":1,"up_from":8,"seq":34359739155,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9845312,"kb_used_data":7794676,"kb_used_omap":603,"kb_used_meta":2050020,"kb_avail":84526528,"statfs":{"total":96636764160,"available":86555164672,"internally_reserved":0,"allocated":7981748224,"data_stored":10106899493,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":618493,"internal_metadata":2099220483},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,8,7,5,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.83399999999999996,"15min":0.75600000000000001},"min":{"1min":0.224,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":6.077,"5min":10.25,"15min":10.25},"last":0.32700000000000001},{"interface":"front","average":{"1min":2.6160000000000001,"5min":1.2050000000000001,"15min":0.91800000000000004},"min":{"1min":0.28199999999999997,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":15.291,"5min":15.291,"15min":15.291},"last":5.5460000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.86399999999999999,"15min":0.89400000000000002},"min":{"1min":0.22500000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":7.5999999999999996,"5min":11.545,"15min":12.074999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.79100000000000004,"15min":0.873},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23200000000000001},"max":{"1min":5.9119999999999999,"5min":11.577999999999999,"15min":12.269},"last":0.35099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739161,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6330108,"kb_used_data":4910516,"kb_used_omap":377,"kb_used_meta":1419206,"kb_avail":88041732,"statfs":{"total":96636764160,"available":90154733568,"internally_reserved":0,"allocated":5028368384,"data_stored":6375163660,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":1453267725},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,1,0,3,3,13],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.738,"15min":1.6180000000000001},"min":{"1min":0.20200000000000001,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":6.7220000000000004,"5min":21.207000000000001,"15min":21.207000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.976,"5min":1.006,"15min":0.83999999999999997},"min":{"1min":0.26100000000000001,"5min":0.20300000000000001,"15min":0.19900000000000001},"max":{"1min":20.436,"5min":20.436,"15min":20.436},"last":0.59199999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.84599999999999997},"min":{"1min":0.193,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":4.0810000000000004,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.1120000000000001,"15min":0.83999999999999997},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":20.491,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.29099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5027704832,"data_stored":6374356498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7982751744,"data_stored":10107759403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953531392,"data_stored":3731887385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:23:00.717 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:00.717 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:00.717 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:00.717 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:00.718 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:00.718 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:00.718 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:00.718 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:00.719 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:23:00.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:00.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:00.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:00.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:00.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:00.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:00.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:00.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:04.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:04.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:04.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:04.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:04.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:04.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:04.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:04.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:04.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:04.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:04.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:04.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:04.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:04.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:04.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:04.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:04.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:04.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:04.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:04.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:05.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:05.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:05.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:05.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:05.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:05.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:05.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:05.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:05.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:05.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:05.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:05.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:05.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:05.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:06.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:06.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:06.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:06.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:06.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:06.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:06.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:06.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:06.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:06.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:06.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:06.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:06.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:06.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:06.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:06.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:06.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:06.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:06.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:06.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:08.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:08.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:08.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:08.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:08.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:08.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:08.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:08.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:08.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:08.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:08.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:08.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:08.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:08.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:08.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:08.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:08.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:08.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:08.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:09.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:09.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:09.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:09.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:09.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:09.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:09.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:09.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:09.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:09.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:09.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:09.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:09.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:09.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:09.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:09.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:09.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:09.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:09.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:09.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:10.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:10.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:10.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:10.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:10.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:10.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:10.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:10.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:10.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:10.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:10.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:10.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:10.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:10.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:10.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:10.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:10.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:10.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:10.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:10.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:23:10.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:10.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:10.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:10.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:10.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:10.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:10.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:10.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:10.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:11.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:11.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:11.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:11.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:11.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:11.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:11.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:11.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:11.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:11.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:11.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:11.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:11.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:11.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:11.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:11.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:11.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:11.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:12.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:12.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:12.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:12.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:12.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:12.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:12.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:12.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:13.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:13.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:13.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:13.088 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:23:13.080+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:23:13.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:13.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:13.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:13.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:13.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:13.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:13.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:13.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:13.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:13.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:13.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:13.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:13.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:13.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:13.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:13.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:13.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:13.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:13.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:13.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:13.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:15.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:15.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:15.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:15.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:15.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:15.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:15.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:15.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:15.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:15.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:15.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:15.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:15.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:15.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:15.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:15.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:16.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:16.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:16.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:16.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:16.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:16.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:16.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:16.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:16.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:16.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:16.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:16.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:16.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:16.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:16.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:16.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:16.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:16.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:16.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:16.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:19.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:19.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:19.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:19.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:19.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:19.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:19.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:19.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:19.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:19.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:19.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:19.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:19.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:19.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:20.720 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:23:21.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:21.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:21.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:21.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:21.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:21.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:21.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:21.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:21.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:23:21.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:21.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:21.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:21.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:21.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:21.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:21.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:21.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:21.521 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:21.516+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:23:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:23:21.585 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:23:21.598 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:21.592+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:23:21.679 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2076,"stamp":"2023-09-23T08:23:20.236610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22518197579,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":1978540,"num_read_kb":7761402,"num_write":1957790,"num_write_kb":7831531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80521,"ondisk_log_size":80521,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":19509020,"kb_used_data":15659328,"kb_used_omap":1202,"kb_used_meta":3848461,"kb_avail":263606500,"statfs":{"total":289910292480,"available":269933056000,"internally_reserved":0,"allocated":16035151872,"data_stored":20285064996,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1230898,"internal_metadata":3940825038},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,2,6,9,10,12,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14790656,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4206,"num_read_kb":16776,"num_write":4313,"num_write_kb":17252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001993"},"pg_stats":[{"pgid":"2.7","version":"79'243066","reported_seq":477893,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:23:17.890657+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:23:17.890657+0000","last_peered":"2023-09-23T08:23:17.890657+0000","last_clean":"2023-09-23T08:23:17.890657+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:23:17.890657+0000","last_undegraded":"2023-09-23T08:23:17.890657+0000","last_fullsized":"2023-09-23T08:23:17.890657+0000","mapping_epoch":13,"log_start":"77'233010","ondisk_log_start":"77'233010","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2657423695,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":234671,"num_read_kb":920658,"num_write":231368,"num_write_kb":925376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"79'266765","reported_seq":525062,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:23:17.903866+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:23:17.903866+0000","last_peered":"2023-09-23T08:23:17.903866+0000","last_clean":"2023-09-23T08:23:17.903866+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:23:17.903866+0000","last_undegraded":"2023-09-23T08:23:17.903866+0000","last_fullsized":"2023-09-23T08:23:17.903866+0000","mapping_epoch":13,"log_start":"77'256707","ondisk_log_start":"77'256707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2959683903,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":258904,"num_read_kb":1011622,"num_write":255101,"num_write_kb":1020173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"79'253467","reported_seq":497555,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:23:17.891068+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:23:17.891068+0000","last_peered":"2023-09-23T08:23:17.891068+0000","last_clean":"2023-09-23T08:23:17.891068+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:23:17.891068+0000","last_undegraded":"2023-09-23T08:23:17.891068+0000","last_fullsized":"2023-09-23T08:23:17.891068+0000","mapping_epoch":13,"log_start":"77'243409","ondisk_log_start":"77'243409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2764181804,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":243912,"num_read_kb":956813,"num_write":241789,"num_write_kb":967069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"79'257528","reported_seq":515565,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:23:17.856907+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:23:17.856907+0000","last_peered":"2023-09-23T08:23:17.856907+0000","last_clean":"2023-09-23T08:23:17.856907+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:23:17.856907+0000","last_undegraded":"2023-09-23T08:23:17.856907+0000","last_fullsized":"2023-09-23T08:23:17.856907+0000","mapping_epoch":13,"log_start":"77'247507","ondisk_log_start":"77'247507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2955096346,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":258690,"num_read_kb":1020803,"num_write":256740,"num_write_kb":1026873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"79'250793","reported_seq":500809,"reported_epoch":79,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:23:16.284197+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:23:16.284197+0000","last_peered":"2023-09-23T08:23:16.284197+0000","last_clean":"2023-09-23T08:23:16.284197+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:23:16.284197+0000","last_undegraded":"2023-09-23T08:23:16.284197+0000","last_fullsized":"2023-09-23T08:23:16.284197+0000","mapping_epoch":13,"log_start":"77'240707","ondisk_log_start":"77'240707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":135,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 39s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2849861950,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":250187,"num_read_kb":981711,"num_write":248350,"num_write_kb":993250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"79'259375","reported_seq":515331,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:23:17.108867+0000","last_change":"2023-09-23T08:23:15.716909+0000","last_active":"2023-09-23T08:23:17.108867+0000","last_peered":"2023-09-23T08:23:17.108867+0000","last_clean":"2023-09-23T08:23:17.108867+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:23:17.108867+0000","last_undegraded":"2023-09-23T08:23:17.108867+0000","last_fullsized":"2023-09-23T08:23:17.108867+0000","mapping_epoch":13,"log_start":"77'249311","ondisk_log_start":"77'249311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2934907350,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":255945,"num_read_kb":1003424,"num_write":254070,"num_write_kb":1016160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"79'237073","reported_seq":471520,"reported_epoch":79,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:23:17.107122+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:23:17.107122+0000","last_peered":"2023-09-23T08:23:17.107122+0000","last_clean":"2023-09-23T08:23:17.107122+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:23:17.107122+0000","last_undegraded":"2023-09-23T08:23:17.107122+0000","last_fullsized":"2023-09-23T08:23:17.107122+0000","mapping_epoch":13,"log_start":"77'227007","ondisk_log_start":"77'227007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":124,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 36s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2663264557,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":234201,"num_read_kb":918205,"num_write":231765,"num_write_kb":926973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"79'250217","reported_seq":492219,"reported_epoch":79,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:23:17.841613+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:23:17.841613+0000","last_peered":"2023-09-23T08:23:17.841613+0000","last_clean":"2023-09-23T08:23:17.841613+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:23:17.841613+0000","last_undegraded":"2023-09-23T08:23:17.841613+0000","last_fullsized":"2023-09-23T08:23:17.841613+0000","mapping_epoch":13,"log_start":"77'240204","ondisk_log_start":"77'240204","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":70,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 36s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2733187606,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":241924,"num_read_kb":948075,"num_write":238470,"num_write_kb":953763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:40.293031+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:22:40.293031+0000","last_peered":"2023-09-23T08:22:40.293031+0000","last_clean":"2023-09-23T08:22:40.293031+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:22:40.293031+0000","last_undegraded":"2023-09-23T08:22:40.293031+0000","last_fullsized":"2023-09-23T08:22:40.293031+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22517607211,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":1978434,"num_read_kb":7761311,"num_write":1957653,"num_write_kb":7829637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16034193408,"data_stored":20284208726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80422,"ondisk_log_size":80422,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739169,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4382520,"kb_used_data":2897132,"kb_used_omap":219,"kb_used_meta":1485156,"kb_avail":89989320,"statfs":{"total":96636764160,"available":92149063680,"internally_reserved":0,"allocated":2966663168,"data_stored":3744629747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1520800589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,0,1,1,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76900000000000002,"15min":0.61699999999999999},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":3.254,"5min":8.2270000000000003,"15min":8.2270000000000003},"last":6.8650000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.877,"15min":1.006},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.2750000000000004,"5min":8.2629999999999999,"15min":25.483000000000001},"last":6.9279999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:22:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1,"15min":0.83299999999999996},"min":{"1min":0.248,"5min":0.215,"15min":0.215},"max":{"1min":7.9859999999999998,"5min":11.65,"15min":25.550000000000001},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94699999999999995,"15min":0.79900000000000004},"min":{"1min":0.23200000000000001,"5min":0.182,"15min":0.182},"max":{"1min":4.5700000000000003,"5min":7.0350000000000001,"15min":8.125},"last":0.30099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739159,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8673524,"kb_used_data":7830316,"kb_used_omap":605,"kb_used_meta":842594,"kb_avail":85698316,"statfs":{"total":96636764160,"available":87755075584,"internally_reserved":0,"allocated":8018243584,"data_stored":10143394853,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":862816628},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,8,3,12,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.83399999999999996,"15min":0.75600000000000001},"min":{"1min":0.224,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":6.077,"5min":10.25,"15min":10.25},"last":0.81999999999999995},{"interface":"front","average":{"1min":2.6160000000000001,"5min":1.2050000000000001,"15min":0.91800000000000004},"min":{"1min":0.28199999999999997,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":15.291,"5min":15.291,"15min":15.291},"last":0.82999999999999996}]},{"osd":2,"last update":"Sat Sep 23 08:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.86399999999999999,"15min":0.89400000000000002},"min":{"1min":0.22500000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":7.5999999999999996,"5min":11.545,"15min":12.074999999999999},"last":0.505},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.79100000000000004,"15min":0.873},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23200000000000001},"max":{"1min":5.9119999999999999,"5min":11.577999999999999,"15min":12.269},"last":0.78000000000000003}]}]},{"osd":0,"up_from":8,"seq":34359739165,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6452976,"kb_used_data":4931880,"kb_used_omap":377,"kb_used_meta":1520710,"kb_avail":87918864,"statfs":{"total":96636764160,"available":90028916736,"internally_reserved":0,"allocated":5050245120,"data_stored":6397040396,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":1557207821},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,3,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.738,"15min":1.6180000000000001},"min":{"1min":0.20200000000000001,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":6.7220000000000004,"5min":21.207000000000001,"15min":21.207000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":1.976,"5min":1.006,"15min":0.83999999999999997},"min":{"1min":0.26100000000000001,"5min":0.20300000000000001,"15min":0.19900000000000001},"max":{"1min":20.436,"5min":20.436,"15min":20.436},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.84599999999999997},"min":{"1min":0.193,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":4.0810000000000004,"5min":15.039999999999999,"15min":15.039999999999999},"last":3.7549999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.1120000000000001,"15min":0.83999999999999997},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":20.491,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.29199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5049659392,"data_stored":6396311058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8018239488,"data_stored":10143247147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2966294528,"data_stored":3744650521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:23:21.680 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:21.681 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:21.681 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:21.681 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:21.681 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:21.681 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:21.682 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:21.682 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:21.682 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:23:21.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:23:21.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:21.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:21.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:21.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:22.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:21.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:22.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:22.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:22.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:22.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:22.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:22.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:22.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:22.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:22.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:22.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:22.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:22.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:23.233 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:23.228+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:23:23.233 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:23.228+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:23:23.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:23.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:23.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:23.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:23.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:23.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:23.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:23.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:23.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:23.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:24.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:24.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:24.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:24.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:24.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:24.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:24.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:24.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:24.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:24.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:24.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:24.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:24.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:24.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:24.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:24.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:25.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:23:25.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:25.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:25.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:25.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:25.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:25.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:25.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:25.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:25.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:25.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:25.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:25.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:26.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:26.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:26.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:26.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:26.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:26.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:26.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:26.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:26.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:26.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:26.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:26.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:26.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:26.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:26.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:26.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:26.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:26.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:26.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:26.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:26.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:27.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:27.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:27.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:27.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:27.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:27.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:27.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:27.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:27.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:27.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:27.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:27.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:27.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:27.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:28.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:28.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:28.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:28.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:28.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:28.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:28.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:28.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:28.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:28.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:28.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:28.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:28.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:28.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:29.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:29.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:29.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:29.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:29.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:29.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:29.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:29.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:29.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:29.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:29.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:29.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:29.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:29.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:29.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:29.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:29.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:29.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:29.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:29.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:30.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:30.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:30.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:30.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:30.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:30.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:30.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:30.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:30.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:30.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:30.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:30.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:30.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:30.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:30.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:30.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:30.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:30.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:30.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:30.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:30.685 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:30.680+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:23:30.685 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:30.680+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:23:30.686 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:30.680+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:23:31.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:31.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:31.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:31.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:31.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:31.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:31.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:31.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:31.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:31.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:31.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:31.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:31.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:31.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:31.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:31.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:31.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:31.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:32.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:32.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:32.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:32.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:32.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:32.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:32.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:32.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:32.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:32.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:23:32.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:32.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:32.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:32.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:32.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:32.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:32.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:32.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:32.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:32.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:32.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:23:32.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:32.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:32.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:32.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:32.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:32.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:32.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:32.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:32.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:32.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:33.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:33.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:33.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:33.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:33.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:33.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:33.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:33.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:33.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:33.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:33.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:33.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:33.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:33.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:34.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:34.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:34.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:34.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:34.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:34.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:34.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:34.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:34.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:34.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:34.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:34.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:34.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:34.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:34.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:34.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:35.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:35.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:35.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:35.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:35.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:35.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:35.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:35.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:35.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:35.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:35.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:35.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:35.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:35.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:35.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:35.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:35.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:35.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:35.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:35.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:35.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:35.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:35.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:35.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:35.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:35.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:35.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:23:35.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:35.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:35.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:35.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:35.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:36.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:36.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:36.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:36.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:36.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:36.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:36.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:36.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:36.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:36.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:36.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:36.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:36.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:36.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:36.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:36.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:36.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:36.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:39.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:39.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:39.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:39.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:39.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:39.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:39.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:39.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:39.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:39.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:39.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:39.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:39.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:39.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:39.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:39.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:39.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:39.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:39.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:39.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:41.682 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:23:42.396 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:23:42.397 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:23:42.449 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2088,"stamp":"2023-09-23T08:23:42.247318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22548434251,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":1986578,"num_read_kb":7793462,"num_write":1966552,"num_write_kb":7866579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80336,"ondisk_log_size":80336,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":19787804,"kb_used_data":15731972,"kb_used_omap":1202,"kb_used_meta":4054605,"kb_avail":263327716,"statfs":{"total":289910292480,"available":269647581184,"internally_reserved":0,"allocated":16109539328,"data_stored":20359452452,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1230898,"internal_metadata":4151916494},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,2,4,8,8,10,7,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14721024,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3953,"num_read_kb":15760,"num_write":4273,"num_write_kb":17092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001562"},"pg_stats":[{"pgid":"2.7","version":"79'244151","reported_seq":479954,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:23:38.270086+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:23:38.270086+0000","last_peered":"2023-09-23T08:23:38.270086+0000","last_clean":"2023-09-23T08:23:38.270086+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:23:38.270086+0000","last_undegraded":"2023-09-23T08:23:38.270086+0000","last_fullsized":"2023-09-23T08:23:38.270086+0000","mapping_epoch":13,"log_start":"77'234110","ondisk_log_start":"77'234110","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2660901199,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":235633,"num_read_kb":924494,"num_write":232377,"num_write_kb":929412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"79'268028","reported_seq":527371,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:23:38.244043+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:23:38.244043+0000","last_peered":"2023-09-23T08:23:38.244043+0000","last_clean":"2023-09-23T08:23:38.244043+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:23:38.244043+0000","last_undegraded":"2023-09-23T08:23:38.244043+0000","last_fullsized":"2023-09-23T08:23:38.244043+0000","mapping_epoch":13,"log_start":"77'258007","ondisk_log_start":"77'258007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2963824959,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":259939,"num_read_kb":1015750,"num_write":256286,"num_write_kb":1024913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"79'254590","reported_seq":499640,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:23:38.242294+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:23:38.242294+0000","last_peered":"2023-09-23T08:23:38.242294+0000","last_clean":"2023-09-23T08:23:38.242294+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:23:38.242294+0000","last_undegraded":"2023-09-23T08:23:38.242294+0000","last_fullsized":"2023-09-23T08:23:38.242294+0000","mapping_epoch":13,"log_start":"77'244509","ondisk_log_start":"77'244509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2767782188,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":244862,"num_read_kb":960601,"num_write":242833,"num_write_kb":971245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"79'258718","reported_seq":517799,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:23:38.198712+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:23:38.198712+0000","last_peered":"2023-09-23T08:23:38.198712+0000","last_clean":"2023-09-23T08:23:38.198712+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:23:38.198712+0000","last_undegraded":"2023-09-23T08:23:38.198712+0000","last_fullsized":"2023-09-23T08:23:38.198712+0000","mapping_epoch":13,"log_start":"77'248707","ondisk_log_start":"77'248707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2959094042,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":259732,"num_read_kb":1024947,"num_write":257930,"num_write_kb":1031633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"79'252144","reported_seq":503350,"reported_epoch":79,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:23:41.528501+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:23:41.528501+0000","last_peered":"2023-09-23T08:23:41.528501+0000","last_clean":"2023-09-23T08:23:41.528501+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:23:41.528501+0000","last_undegraded":"2023-09-23T08:23:41.528501+0000","last_fullsized":"2023-09-23T08:23:41.528501+0000","mapping_epoch":13,"log_start":"77'242107","ondisk_log_start":"77'242107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":223,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 64s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2854338878,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":251359,"num_read_kb":986391,"num_write":249633,"num_write_kb":998382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"79'260434","reported_seq":517416,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:23:37.350988+0000","last_change":"2023-09-23T08:23:34.058766+0000","last_active":"2023-09-23T08:23:37.350988+0000","last_peered":"2023-09-23T08:23:37.350988+0000","last_clean":"2023-09-23T08:23:37.350988+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:23:37.350988+0000","last_undegraded":"2023-09-23T08:23:37.350988+0000","last_fullsized":"2023-09-23T08:23:37.350988+0000","mapping_epoch":13,"log_start":"77'250411","ondisk_log_start":"77'250411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2938544598,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":256952,"num_read_kb":1007448,"num_write":255111,"num_write_kb":1020324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"79'238118","reported_seq":473523,"reported_epoch":79,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:23:37.352197+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:23:37.352197+0000","last_peered":"2023-09-23T08:23:37.352197+0000","last_clean":"2023-09-23T08:23:37.352197+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:23:37.352197+0000","last_undegraded":"2023-09-23T08:23:37.352197+0000","last_fullsized":"2023-09-23T08:23:37.352197+0000","mapping_epoch":13,"log_start":"77'228107","ondisk_log_start":"77'228107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":162,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 56s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2666742061,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":235140,"num_read_kb":921941,"num_write":232770,"num_write_kb":930993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"79'251316","reported_seq":494270,"reported_epoch":79,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:23:38.243009+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:23:38.243009+0000","last_peered":"2023-09-23T08:23:38.243009+0000","last_clean":"2023-09-23T08:23:38.243009+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:23:38.243009+0000","last_undegraded":"2023-09-23T08:23:38.243009+0000","last_fullsized":"2023-09-23T08:23:38.243009+0000","mapping_epoch":13,"log_start":"77'241304","ondisk_log_start":"77'241304","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":112,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 57s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2736615958,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":242855,"num_read_kb":951799,"num_write":239475,"num_write_kb":957783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:40.293031+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:22:40.293031+0000","last_peered":"2023-09-23T08:22:40.293031+0000","last_clean":"2023-09-23T08:22:40.293031+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:22:40.293031+0000","last_undegraded":"2023-09-23T08:22:40.293031+0000","last_fullsized":"2023-09-23T08:22:40.293031+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22547843883,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":1986472,"num_read_kb":7793371,"num_write":1966415,"num_write_kb":7864685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16109281280,"data_stored":20359296598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80237,"ondisk_log_size":80237,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739173,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4466380,"kb_used_data":2909188,"kb_used_omap":219,"kb_used_meta":1556964,"kb_avail":89905460,"statfs":{"total":96636764160,"available":92063191040,"internally_reserved":0,"allocated":2979008512,"data_stored":3756975091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1594331981},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,1,1,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76900000000000002,"15min":0.61699999999999999},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":3.254,"5min":8.2270000000000003,"15min":8.2270000000000003},"last":0.314},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.877,"15min":1.006},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.2750000000000004,"5min":8.2629999999999999,"15min":25.483000000000001},"last":0.27300000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:22:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1,"15min":0.83299999999999996},"min":{"1min":0.248,"5min":0.215,"15min":0.215},"max":{"1min":7.9859999999999998,"5min":11.65,"15min":25.550000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94699999999999995,"15min":0.79900000000000004},"min":{"1min":0.23200000000000001,"5min":0.182,"15min":0.182},"max":{"1min":4.5700000000000003,"5min":7.0350000000000001,"15min":8.125},"last":0.83199999999999996}]}]},{"osd":1,"up_from":8,"seq":34359739163,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8742848,"kb_used_data":7863800,"kb_used_omap":605,"kb_used_meta":878434,"kb_avail":85628992,"statfs":{"total":96636764160,"available":87684087808,"internally_reserved":0,"allocated":8052531200,"data_stored":10177682469,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":899516788},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,3,6,7,9,6,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.83399999999999996,"15min":0.75600000000000001},"min":{"1min":0.224,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":6.077,"5min":10.25,"15min":10.25},"last":0.36099999999999999},{"interface":"front","average":{"1min":2.6160000000000001,"5min":1.2050000000000001,"15min":0.91800000000000004},"min":{"1min":0.28199999999999997,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":15.291,"5min":15.291,"15min":15.291},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.86399999999999999,"15min":0.89400000000000002},"min":{"1min":0.22500000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":7.5999999999999996,"5min":11.545,"15min":12.074999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.79100000000000004,"15min":0.873},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23200000000000001},"max":{"1min":5.9119999999999999,"5min":11.577999999999999,"15min":12.269},"last":0.28799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739170,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6578576,"kb_used_data":4958984,"kb_used_omap":377,"kb_used_meta":1619206,"kb_avail":87793264,"statfs":{"total":96636764160,"available":89900302336,"internally_reserved":0,"allocated":5077999616,"data_stored":6424794892,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":1658067725},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.738,"15min":1.6180000000000001},"min":{"1min":0.20200000000000001,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":6.7220000000000004,"5min":21.207000000000001,"15min":21.207000000000001},"last":2.7650000000000001},{"interface":"front","average":{"1min":1.976,"5min":1.006,"15min":0.83999999999999997},"min":{"1min":0.26100000000000001,"5min":0.20300000000000001,"15min":0.19900000000000001},"max":{"1min":20.436,"5min":20.436,"15min":20.436},"last":2.8010000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:23:28 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.76400000000000001,"15min":0.78500000000000003},"min":{"1min":0.20300000000000001,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":9.0150000000000006,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":1.002,"15min":0.83499999999999996},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.61799999999999999,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.26100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5077483520,"data_stored":6424135186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8053096448,"data_stored":10178104107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2978701312,"data_stored":3757057305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:23:42.451 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:42.451 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:42.451 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:42.451 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:42.452 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:42.452 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:42.452 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:42.452 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:23:42.452 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:23:42.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:42.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:42.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:42.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:42.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:42.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:42.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:42.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:42.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:42.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:42.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:42.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:42.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:42.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:42.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:42.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:42.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:42.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:42.978 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:42.972+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:23:42.978 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:42.972+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:23:43.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:43.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:43.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:43.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:43.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:43.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:43.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:43.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:43.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:43.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:43.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:43.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:43.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:43.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:43.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:43.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:43.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:43.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:45.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:45.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:45.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:45.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:45.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:45.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:45.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:45.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:45.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:45.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:45.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:23:45.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:45.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:45.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:45.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:45.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:45.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:45.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:45.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:45.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:45.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:45.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:23:45.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:45.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:46.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:46.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:46.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:46.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:46.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:46.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:46.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:46.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:46.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:46.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:46.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:46.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:46.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:46.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:46.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:46.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:46.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:46.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:47.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:47.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:47.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:47.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:47.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:47.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:47.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:47.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:47.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:47.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:47.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:47.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:47.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:47.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:48.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:48.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:48.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:48.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:48.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:48.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:48.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:48.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:48.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:48.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:48.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:48.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:48.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:48.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:48.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:48.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:48.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:48.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:48.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:48.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:50.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:50.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:50.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:50.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:50.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:50.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:50.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:50.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:50.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:50.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:50.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:50.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:50.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:50.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:50.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:50.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:50.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:50.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:50.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:50.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:52.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:52.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:52.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:52.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:52.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:52.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:52.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:52.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:52.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:52.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:52.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:52.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:52.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:52.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:52.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:52.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:53.473 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:53.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:23:53.473 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:53.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:23:53.474 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:23:53.467+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:23:53.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:53.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:53.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:53.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:53.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:53.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:53.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:53.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:53.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:53.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:53.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:53.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:53.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:53.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:53.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:53.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:54.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:54.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:54.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:54.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:54.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:54.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:54.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:54.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:23:54.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:54.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:54.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:54.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:54.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:54.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:54.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:54.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:54.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:54.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:55.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:55.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:55.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:55.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:55.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:55.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:55.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:55.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:55.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:55.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:55.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:55.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:55.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:55.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:57.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:57.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:23:57.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:57.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:23:57.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:57.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:23:57.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:57.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:23:57.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:57.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:23:57.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:57.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:23:57.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:57.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:23:57.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:57.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:23:57.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:57.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:23:57.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:23:57.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:23:58.003 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:23:57.995+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:24:01.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:01.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:01.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:01.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:01.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:01.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:01.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:01.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:01.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:01.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:01.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:01.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:01.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:01.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:01.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:01.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:01.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:01.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:01.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:02.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:02.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:02.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:02.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:02.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:02.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:02.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:02.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:02.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:02.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:02.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:02.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:02.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:02.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:02.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:02.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:02.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:02.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:02.454 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:24:03.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:03.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:24:03.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:03.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:24:03.416 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:24:03.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:03.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:03.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:03.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:03.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:03.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:03.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:03.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:03.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:03.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:03.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:03.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:03.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:03.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:03.448 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2098,"stamp":"2023-09-23T08:24:02.260713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22578273611,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":1995030,"num_read_kb":7827178,"num_write":1975180,"num_write_kb":7901091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80398,"ondisk_log_size":80398,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20077972,"kb_used_data":15801468,"kb_used_omap":1202,"kb_used_meta":4275277,"kb_avail":263037548,"statfs":{"total":289910292480,"available":269350449152,"internally_reserved":0,"allocated":16180703232,"data_stored":20430602337,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1230898,"internal_metadata":4377884622},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,3,9,8,12,4,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15839232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4421,"num_read_kb":17648,"num_write":4553,"num_write_kb":18212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009090"},"pg_stats":[{"pgid":"2.7","version":"80'245225","reported_seq":482149,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:23:58.819147+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:23:58.819147+0000","last_peered":"2023-09-23T08:23:58.819147+0000","last_clean":"2023-09-23T08:23:58.819147+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:23:58.819147+0000","last_undegraded":"2023-09-23T08:23:58.819147+0000","last_fullsized":"2023-09-23T08:23:58.819147+0000","mapping_epoch":13,"log_start":"77'235210","ondisk_log_start":"77'235210","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2664399183,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":236740,"num_read_kb":928918,"num_write":233404,"num_write_kb":933520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"80'269248","reported_seq":529730,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:23:58.789527+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:23:58.789527+0000","last_peered":"2023-09-23T08:23:58.789527+0000","last_clean":"2023-09-23T08:23:58.789527+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:23:58.789527+0000","last_undegraded":"2023-09-23T08:23:58.789527+0000","last_fullsized":"2023-09-23T08:23:58.789527+0000","mapping_epoch":13,"log_start":"77'259207","ondisk_log_start":"77'259207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2967953727,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":261067,"num_read_kb":1020254,"num_write":257458,"num_write_kb":1029601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"80'255721","reported_seq":501776,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:23:58.791524+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:23:58.791524+0000","last_peered":"2023-09-23T08:23:58.791524+0000","last_clean":"2023-09-23T08:23:58.791524+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:23:58.791524+0000","last_undegraded":"2023-09-23T08:23:58.791524+0000","last_fullsized":"2023-09-23T08:23:58.791524+0000","mapping_epoch":13,"log_start":"77'245709","ondisk_log_start":"77'245709","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2771525932,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":245854,"num_read_kb":964557,"num_write":243916,"num_write_kb":975577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"80'259951","reported_seq":520222,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:23:58.808010+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:23:58.808010+0000","last_peered":"2023-09-23T08:23:58.808010+0000","last_clean":"2023-09-23T08:23:58.808010+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:23:58.808010+0000","last_undegraded":"2023-09-23T08:23:58.808010+0000","last_fullsized":"2023-09-23T08:23:58.808010+0000","mapping_epoch":13,"log_start":"77'249907","ondisk_log_start":"77'249907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2963345690,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":260924,"num_read_kb":1029703,"num_write":259163,"num_write_kb":1036565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"80'253173","reported_seq":505394,"reported_epoch":80,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:24:01.677640+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:24:01.677640+0000","last_peered":"2023-09-23T08:24:01.677640+0000","last_clean":"2023-09-23T08:24:01.677640+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:24:01.677640+0000","last_undegraded":"2023-09-23T08:24:01.677640+0000","last_fullsized":"2023-09-23T08:24:01.677640+0000","mapping_epoch":13,"log_start":"77'243107","ondisk_log_start":"77'243107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":283,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 84s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2857873726,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":252354,"num_read_kb":990363,"num_write":250626,"num_write_kb":1002354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"80'261513","reported_seq":519556,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:23:57.658941+0000","last_change":"2023-09-23T08:23:54.051733+0000","last_active":"2023-09-23T08:23:57.658941+0000","last_peered":"2023-09-23T08:23:57.658941+0000","last_clean":"2023-09-23T08:23:57.658941+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:23:57.658941+0000","last_undegraded":"2023-09-23T08:23:57.658941+0000","last_fullsized":"2023-09-23T08:23:57.658941+0000","mapping_epoch":13,"log_start":"77'251511","ondisk_log_start":"77'251511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2942235094,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":257995,"num_read_kb":1011604,"num_write":256172,"num_write_kb":1024568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"80'239191","reported_seq":475611,"reported_epoch":80,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:23:57.681992+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:23:57.681992+0000","last_peered":"2023-09-23T08:23:57.681992+0000","last_clean":"2023-09-23T08:23:57.681992+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:23:57.681992+0000","last_undegraded":"2023-09-23T08:23:57.681992+0000","last_fullsized":"2023-09-23T08:23:57.681992+0000","mapping_epoch":13,"log_start":"77'229107","ondisk_log_start":"77'229107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":220,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 76s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2670248237,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":236134,"num_read_kb":925893,"num_write":233786,"num_write_kb":935057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"80'252439","reported_seq":496415,"reported_epoch":80,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:23:58.822362+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:23:58.822362+0000","last_peered":"2023-09-23T08:23:58.822362+0000","last_clean":"2023-09-23T08:23:58.822362+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:23:58.822362+0000","last_undegraded":"2023-09-23T08:23:58.822362+0000","last_fullsized":"2023-09-23T08:23:58.822362+0000","mapping_epoch":13,"log_start":"77'242404","ondisk_log_start":"77'242404","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":162,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 77s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2740101654,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":243856,"num_read_kb":955795,"num_write":240518,"num_write_kb":961955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":249,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-09-23T08:22:40.293082+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:22:40.293082+0000","last_peered":"2023-09-23T08:22:40.293082+0000","last_clean":"2023-09-23T08:22:40.293082+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:22:40.293082+0000","last_undegraded":"2023-09-23T08:22:40.293082+0000","last_fullsized":"2023-09-23T08:22:40.293082+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22577683243,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":1994924,"num_read_kb":7827087,"num_write":1975043,"num_write_kb":7899197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16179838976,"data_stored":20429854294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80299,"ondisk_log_size":80299,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739177,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4514808,"kb_used_data":2921584,"kb_used_omap":219,"kb_used_meta":1592996,"kb_avail":89857032,"statfs":{"total":96636764160,"available":92013600768,"internally_reserved":0,"allocated":2991702016,"data_stored":3769663922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1631228749},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,0,1,1,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:22:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76900000000000002,"15min":0.61699999999999999},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":3.254,"5min":8.2270000000000003,"15min":8.2270000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.877,"15min":1.006},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.2750000000000004,"5min":8.2629999999999999,"15min":25.483000000000001},"last":1.03}]},{"osd":1,"last update":"Sat Sep 23 08:22:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1,"15min":0.83299999999999996},"min":{"1min":0.248,"5min":0.215,"15min":0.215},"max":{"1min":7.9859999999999998,"5min":11.65,"15min":25.550000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94699999999999995,"15min":0.79900000000000004},"min":{"1min":0.23200000000000001,"5min":0.182,"15min":0.182},"max":{"1min":4.5700000000000003,"5min":7.0350000000000001,"15min":8.125},"last":1.0660000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739167,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8878392,"kb_used_data":7899376,"kb_used_omap":605,"kb_used_meta":978402,"kb_avail":85493448,"statfs":{"total":96636764160,"available":87545290752,"internally_reserved":0,"allocated":8088961024,"data_stored":10214107620,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":1001884020},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,6,8,8,2,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.749,"15min":0.72599999999999998},"min":{"1min":0.25600000000000001,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":0.81999999999999995,"5min":10.25,"15min":10.25},"last":0.26100000000000001},{"interface":"front","average":{"1min":2.0190000000000001,"5min":1.458,"15min":0.995},"min":{"1min":0.25700000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":14.914,"5min":15.291,"15min":15.291},"last":0.309}]},{"osd":2,"last update":"Sat Sep 23 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.89600000000000002,"15min":0.89900000000000002},"min":{"1min":0.26000000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.915,"5min":11.545,"15min":12.074999999999999},"last":0.224},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.79200000000000004,"15min":0.86399999999999999},"min":{"1min":0.28000000000000003,"5min":0.23999999999999999,"15min":0.23599999999999999},"max":{"1min":1.1919999999999999,"5min":11.577999999999999,"15min":12.269},"last":0.36699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739174,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6684772,"kb_used_data":4980508,"kb_used_omap":377,"kb_used_meta":1703878,"kb_avail":87687068,"statfs":{"total":96636764160,"available":89791557632,"internally_reserved":0,"allocated":5100040192,"data_stored":6446830795,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":1744771853},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,3,1,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.6279999999999999,"15min":1.5700000000000001},"min":{"1min":0.186,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":2.7650000000000001,"5min":21.207000000000001,"15min":21.207000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.99199999999999999,"15min":0.81399999999999995},"min":{"1min":0.27400000000000002,"5min":0.20300000000000001,"15min":0.19900000000000001},"max":{"1min":2.8010000000000002,"5min":20.436,"15min":20.436},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:23:28 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.76400000000000001,"15min":0.78500000000000003},"min":{"1min":0.20300000000000001,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":9.0150000000000006,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.315},{"interface":"front","average":{"1min":0.33900000000000002,"5min":1.002,"15min":0.83499999999999996},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.61799999999999999,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.46400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5099700224,"data_stored":6446351890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8088674304,"data_stored":10213681963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2991464448,"data_stored":3769820441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:24:03.450 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:03.450 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:03.450 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:03.451 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:03.451 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:03.451 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:03.451 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:03.451 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:03.452 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:24:03.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:03.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:05.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:05.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:05.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:05.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:05.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:05.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:05.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:05.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:05.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:05.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:05.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:05.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:05.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:05.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:05.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:05.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:05.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:05.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:05.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:05.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:05.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:07.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:07.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:07.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:07.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:07.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:07.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:07.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:07.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:07.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:07.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:07.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:07.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:07.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:07.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:07.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:08.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:08.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:07.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:08.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:08.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:08.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:08.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:08.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:08.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:08.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:08.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:09.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:24:09.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:09.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:09.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:09.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:09.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:09.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:09.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:09.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:09.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:09.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:09.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:09.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:09.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:09.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:09.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:09.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:09.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:09.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:09.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:09.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:09.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:09.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:09.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:11.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:11.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:24:11.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:11.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:11.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:11.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:11.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:11.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:11.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:11.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:11.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:11.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:11.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:11.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:11.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:11.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:11.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:11.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:11.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:11.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:12.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:24:12.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:12.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:12.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:12.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.379+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:12.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:12.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:12.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:12.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:12.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:12.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:12.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:12.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:12.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:12.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:12.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:12.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:12.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:12.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:12.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:12.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:12.641 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:12.635+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:24:12.642 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:12.635+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:24:13.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:13.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:13.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:13.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:13.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:13.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:13.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:13.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:13.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:13.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:13.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:13.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:13.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:13.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:13.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:13.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:14.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:14.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:14.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:14.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:14.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:14.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:14.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:14.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:14.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:24:14.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:14.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:14.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:14.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:14.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:14.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:14.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:14.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:14.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:15.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:15.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:15.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:15.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:15.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:15.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:15.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:15.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:15.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:15.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:15.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:15.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:19.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:19.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:19.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:19.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:19.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:19.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:19.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:19.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:19.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:19.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:19.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:19.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:19.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:19.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:19.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:19.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:20.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:20.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:20.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:20.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:20.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:20.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:20.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:20.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:21.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:21.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:21.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:21.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:21.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:21.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:21.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:21.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:21.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:21.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:21.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:21.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:21.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:21.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:21.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:21.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:22.610 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:22.603+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:24:23.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:23.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:23.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:23.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:23.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:23.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:23.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:23.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:23.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:23.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:23.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:23.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:23.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:23.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:23.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:23.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:23.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:23.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:23.453 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:24:24.195 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:24:24.195 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:24:24.274 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2108,"stamp":"2023-09-23T08:24:22.263913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22608751947,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2003618,"num_read_kb":7861466,"num_write":1983924,"num_write_kb":7936067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80455,"ondisk_log_size":80455,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20436148,"kb_used_data":15870936,"kb_used_omap":1202,"kb_used_meta":4563981,"kb_avail":262679372,"statfs":{"total":289910292480,"available":268983676928,"internally_reserved":0,"allocated":16251838464,"data_stored":20501737569,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1230898,"internal_metadata":4673517518},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,10,6,11,11,4,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16363520,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4618,"num_read_kb":18432,"num_write":4702,"num_write_kb":18808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001899"},"pg_stats":[{"pgid":"2.7","version":"80'246328","reported_seq":484309,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:19.279388+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:24:19.279388+0000","last_peered":"2023-09-23T08:24:19.279388+0000","last_clean":"2023-09-23T08:24:19.279388+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:24:19.279388+0000","last_undegraded":"2023-09-23T08:24:19.279388+0000","last_fullsized":"2023-09-23T08:24:19.279388+0000","mapping_epoch":13,"log_start":"78'236310","ondisk_log_start":"78'236310","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2667999567,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":237785,"num_read_kb":933082,"num_write":234456,"num_write_kb":937728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"80'270435","reported_seq":532105,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:19.291297+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:24:19.291297+0000","last_peered":"2023-09-23T08:24:19.291297+0000","last_clean":"2023-09-23T08:24:19.291297+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:24:19.291297+0000","last_undegraded":"2023-09-23T08:24:19.291297+0000","last_fullsized":"2023-09-23T08:24:19.291297+0000","mapping_epoch":13,"log_start":"78'260407","ondisk_log_start":"78'260407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2971988287,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":262248,"num_read_kb":1024966,"num_write":258594,"num_write_kb":1034145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"80'256880","reported_seq":503953,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:19.269473+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:24:19.269473+0000","last_peered":"2023-09-23T08:24:19.269473+0000","last_clean":"2023-09-23T08:24:19.269473+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:24:19.269473+0000","last_undegraded":"2023-09-23T08:24:19.269473+0000","last_fullsized":"2023-09-23T08:24:19.269473+0000","mapping_epoch":13,"log_start":"78'246809","ondisk_log_start":"78'246809","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2775241004,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":246860,"num_read_kb":968573,"num_write":245024,"num_write_kb":980009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"80'261114","reported_seq":522485,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:19.273124+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:24:19.273124+0000","last_peered":"2023-09-23T08:24:19.273124+0000","last_clean":"2023-09-23T08:24:19.273124+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:24:19.273124+0000","last_undegraded":"2023-09-23T08:24:19.273124+0000","last_fullsized":"2023-09-23T08:24:19.273124+0000","mapping_epoch":13,"log_start":"78'251107","ondisk_log_start":"78'251107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2967511322,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":262023,"num_read_kb":1034091,"num_write":260326,"num_write_kb":1041217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"80'254315","reported_seq":507670,"reported_epoch":80,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:24:21.887670+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:24:21.887670+0000","last_peered":"2023-09-23T08:24:21.887670+0000","last_clean":"2023-09-23T08:24:21.887670+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:24:21.887670+0000","last_undegraded":"2023-09-23T08:24:21.887670+0000","last_fullsized":"2023-09-23T08:24:21.887670+0000","mapping_epoch":13,"log_start":"78'244307","ondisk_log_start":"78'244307","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":307,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 104s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2861891902,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":253468,"num_read_kb":994811,"num_write":251749,"num_write_kb":1006846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"80'262580","reported_seq":521681,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:17.952403+0000","last_change":"2023-09-23T08:24:16.243506+0000","last_active":"2023-09-23T08:24:17.952403+0000","last_peered":"2023-09-23T08:24:17.952403+0000","last_clean":"2023-09-23T08:24:17.952403+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:24:17.952403+0000","last_undegraded":"2023-09-23T08:24:17.952403+0000","last_fullsized":"2023-09-23T08:24:17.952403+0000","mapping_epoch":13,"log_start":"78'252511","ondisk_log_start":"78'252511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2945995222,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":259034,"num_read_kb":1015760,"num_write":257224,"num_write_kb":1028776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"80'240280","reported_seq":477790,"reported_epoch":80,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:24:17.951723+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:24:17.951723+0000","last_peered":"2023-09-23T08:24:17.951723+0000","last_clean":"2023-09-23T08:24:17.951723+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:24:17.951723+0000","last_undegraded":"2023-09-23T08:24:17.951723+0000","last_fullsized":"2023-09-23T08:24:17.951723+0000","mapping_epoch":13,"log_start":"77'230207","ondisk_log_start":"77'230207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":267,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 97s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2673803565,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":237201,"num_read_kb":930153,"num_write":234828,"num_write_kb":939225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"80'253586","reported_seq":498622,"reported_epoch":80,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:24:19.253074+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:24:19.253074+0000","last_peered":"2023-09-23T08:24:19.253074+0000","last_clean":"2023-09-23T08:24:19.253074+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:24:19.253074+0000","last_undegraded":"2023-09-23T08:24:19.253074+0000","last_fullsized":"2023-09-23T08:24:19.253074+0000","mapping_epoch":13,"log_start":"78'243504","ondisk_log_start":"78'243504","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":201,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 98s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2743730710,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":244893,"num_read_kb":959939,"num_write":241586,"num_write_kb":966227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":250,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:23:41.921621+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:23:41.921621+0000","last_peered":"2023-09-23T08:23:41.921621+0000","last_clean":"2023-09-23T08:23:41.921621+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:23:41.921621+0000","last_undegraded":"2023-09-23T08:23:41.921621+0000","last_fullsized":"2023-09-23T08:23:41.921621+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22608161579,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2003512,"num_read_kb":7861375,"num_write":1983787,"num_write_kb":7934173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16251199488,"data_stored":20501214806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80356,"ondisk_log_size":80356,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739181,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4600552,"kb_used_data":2934112,"kb_used_omap":219,"kb_used_meta":1666212,"kb_avail":89771288,"statfs":{"total":96636764160,"available":91925798912,"internally_reserved":0,"allocated":3004530688,"data_stored":3782492594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1706201933},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":0.95499999999999996,"15min":0.67400000000000004},"min":{"1min":0.185,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":9.2750000000000004,"5min":9.2750000000000004,"15min":9.2750000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90100000000000002,"15min":1.0229999999999999},"min":{"1min":0.224,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":6.9279999999999999,"5min":8.2629999999999999,"15min":25.483000000000001},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":1.0940000000000001,"15min":0.85399999999999998},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.215},"max":{"1min":3.3650000000000002,"5min":11.65,"15min":25.550000000000001},"last":0.378},{"interface":"front","average":{"1min":1.9079999999999999,"5min":1.242,"15min":0.879},"min":{"1min":0.23999999999999999,"5min":0.182,"15min":0.182},"max":{"1min":10.013,"5min":10.013,"15min":10.013},"last":0.41199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739171,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9034324,"kb_used_data":7934152,"kb_used_omap":605,"kb_used_meta":1099554,"kb_avail":85337516,"statfs":{"total":96636764160,"available":87385616384,"internally_reserved":0,"allocated":8124571648,"data_stored":10249718244,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":1125943668},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,7,4,6,7,4,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.749,"15min":0.72599999999999998},"min":{"1min":0.25600000000000001,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":0.81999999999999995,"5min":10.25,"15min":10.25},"last":0.29799999999999999},{"interface":"front","average":{"1min":2.0190000000000001,"5min":1.458,"15min":0.995},"min":{"1min":0.25700000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":14.914,"5min":15.291,"15min":15.291},"last":0.20799999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.89600000000000002,"15min":0.89900000000000002},"min":{"1min":0.26000000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.915,"5min":11.545,"15min":12.074999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.79200000000000004,"15min":0.86399999999999999},"min":{"1min":0.28000000000000003,"5min":0.23999999999999999,"15min":0.23599999999999999},"max":{"1min":1.1919999999999999,"5min":11.577999999999999,"15min":12.269},"last":0.23400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6801272,"kb_used_data":5002672,"kb_used_omap":377,"kb_used_meta":1798214,"kb_avail":87570568,"statfs":{"total":96636764160,"available":89672261632,"internally_reserved":0,"allocated":5122736128,"data_stored":6469526731,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":1841371917},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,1,5,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.6279999999999999,"15min":1.5700000000000001},"min":{"1min":0.186,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":2.7650000000000001,"5min":21.207000000000001,"15min":21.207000000000001},"last":0.17799999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.99199999999999999,"15min":0.81399999999999995},"min":{"1min":0.27400000000000002,"5min":0.20300000000000001,"15min":0.19900000000000001},"max":{"1min":2.8010000000000002,"5min":20.436,"15min":20.436},"last":0.249}]},{"osd":2,"last update":"Sat Sep 23 08:23:28 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.76400000000000001,"15min":0.78500000000000003},"min":{"1min":0.20300000000000001,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":9.0150000000000006,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.747},{"interface":"front","average":{"1min":0.33900000000000002,"5min":1.002,"15min":0.83499999999999996},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.61799999999999999,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.36499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5122293760,"data_stored":6468945426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8124579840,"data_stored":10249587499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3004325888,"data_stored":3782681881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:24:24.275 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:24.276 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:24.276 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:24.276 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:24.276 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:24.276 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:24.277 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:24.277 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:24.277 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:24:27.135 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:27.131+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:24:27.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:27.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:28.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:28.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:28.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:28.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:28.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:28.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:28.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:28.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:28.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:28.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:28.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:28.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:28.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:28.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:28.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:28.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:30.409 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:30.403+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:24:30.410 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:30.403+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:24:30.410 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:30.403+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:24:31.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:31.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:32.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:32.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:32.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:32.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:32.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:32.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:32.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:32.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:32.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:32.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:32.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:32.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:32.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:32.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:32.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:32.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:32.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:32.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:32.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:34.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:34.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:34.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:34.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:35.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:35.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:35.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:35.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:35.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:35.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:35.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:35.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:36.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:24:36.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:36.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:36.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:36.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:36.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:36.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:36.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:36.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:36.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:36.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:36.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:36.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:39.001 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:38.995+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:24:39.001 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:38.995+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:24:39.001 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:38.995+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:24:39.006 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:38.999+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:24:39.006 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:38.999+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:24:39.543 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:39.535+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:24:39.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:39.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:39.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:39.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:39.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:39.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:39.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:39.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:39.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:39.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:39.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:39.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:39.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:39.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:39.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:39.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:40.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:40.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:40.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:40.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:40.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:40.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:40.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:40.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:40.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:40.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:40.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:40.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:40.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:40.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:40.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:40.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:40.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:40.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:40.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:40.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:42.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:42.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:42.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:42.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:42.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:42.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:42.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:42.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:42.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:42.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:42.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:42.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:42.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:42.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:42.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:42.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:42.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:42.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:42.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:42.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:43.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:43.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:43.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:43.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:43.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:43.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:43.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:43.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:43.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:43.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:43.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:43.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:43.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:43.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:43.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:43.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:44.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:24:45.125 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:24:45.126 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:24:45.159 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2119,"stamp":"2023-09-23T08:24:44.268686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22640995659,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2012655,"num_read_kb":7897570,"num_write":1993257,"num_write_kb":7973399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80534,"ondisk_log_size":80534,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20784688,"kb_used_data":15944280,"kb_used_omap":1202,"kb_used_meta":4839181,"kb_avail":262330832,"statfs":{"total":289910292480,"available":268626771968,"internally_reserved":0,"allocated":16326942720,"data_stored":20576841825,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1230898,"internal_metadata":4955322318},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,3,3,12,12,17,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16801792,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4930,"num_read_kb":19700,"num_write":4890,"num_write_kb":19560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001864"},"pg_stats":[{"pgid":"2.7","version":"80'247433","reported_seq":486466,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:39.679863+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:24:39.679863+0000","last_peered":"2023-09-23T08:24:39.679863+0000","last_clean":"2023-09-23T08:24:39.679863+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:24:39.679863+0000","last_undegraded":"2023-09-23T08:24:39.679863+0000","last_fullsized":"2023-09-23T08:24:39.679863+0000","mapping_epoch":13,"log_start":"78'237410","ondisk_log_start":"78'237410","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2671661391,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":238826,"num_read_kb":937234,"num_write":235531,"num_write_kb":942028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"80'271679","reported_seq":534506,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:39.674951+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:24:39.674951+0000","last_peered":"2023-09-23T08:24:39.674951+0000","last_clean":"2023-09-23T08:24:39.674951+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:24:39.674951+0000","last_undegraded":"2023-09-23T08:24:39.674951+0000","last_fullsized":"2023-09-23T08:24:39.674951+0000","mapping_epoch":13,"log_start":"78'261607","ondisk_log_start":"78'261607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2976350527,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":263389,"num_read_kb":1029522,"num_write":259808,"num_write_kb":1039001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"80'257943","reported_seq":505995,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:39.679309+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:24:39.679309+0000","last_peered":"2023-09-23T08:24:39.679309+0000","last_clean":"2023-09-23T08:24:39.679309+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:24:39.679309+0000","last_undegraded":"2023-09-23T08:24:39.679309+0000","last_fullsized":"2023-09-23T08:24:39.679309+0000","mapping_epoch":13,"log_start":"78'247909","ondisk_log_start":"78'247909","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2778710316,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":247828,"num_read_kb":972445,"num_write":246057,"num_write_kb":984141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"80'262235","reported_seq":524644,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:39.688196+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:24:39.688196+0000","last_peered":"2023-09-23T08:24:39.688196+0000","last_clean":"2023-09-23T08:24:39.688196+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:24:39.688196+0000","last_undegraded":"2023-09-23T08:24:39.688196+0000","last_fullsized":"2023-09-23T08:24:39.688196+0000","mapping_epoch":13,"log_start":"78'252207","ondisk_log_start":"78'252207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2971545882,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":263061,"num_read_kb":1038235,"num_write":261447,"num_write_kb":1045701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"80'255480","reported_seq":509891,"reported_epoch":80,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:24:42.146350+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:24:42.146350+0000","last_peered":"2023-09-23T08:24:42.146350+0000","last_clean":"2023-09-23T08:24:42.146350+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:24:42.146350+0000","last_undegraded":"2023-09-23T08:24:42.146350+0000","last_fullsized":"2023-09-23T08:24:42.146350+0000","mapping_epoch":13,"log_start":"78'245407","ondisk_log_start":"78'245407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":366,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 124s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2865897790,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":254510,"num_read_kb":998979,"num_write":252863,"num_write_kb":1011302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"80'263902","reported_seq":524358,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:43.304263+0000","last_change":"2023-09-23T08:24:39.728726+0000","last_active":"2023-09-23T08:24:43.304263+0000","last_peered":"2023-09-23T08:24:43.304263+0000","last_clean":"2023-09-23T08:24:43.304263+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:24:43.304263+0000","last_undegraded":"2023-09-23T08:24:43.304263+0000","last_fullsized":"2023-09-23T08:24:43.304263+0000","mapping_epoch":13,"log_start":"78'253811","ondisk_log_start":"78'253811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2950418902,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":260368,"num_read_kb":1021088,"num_write":258516,"num_write_kb":1033944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"80'241773","reported_seq":480739,"reported_epoch":80,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:24:43.331357+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:24:43.331357+0000","last_peered":"2023-09-23T08:24:43.331357+0000","last_clean":"2023-09-23T08:24:43.331357+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:24:43.331357+0000","last_undegraded":"2023-09-23T08:24:43.331357+0000","last_fullsized":"2023-09-23T08:24:43.331357+0000","mapping_epoch":13,"log_start":"78'231707","ondisk_log_start":"78'231707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":350,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 122s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2678509869,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":238631,"num_read_kb":935869,"num_write":236234,"num_write_kb":944849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"80'254752","reported_seq":500851,"reported_epoch":80,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:24:39.665922+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:24:39.665922+0000","last_peered":"2023-09-23T08:24:39.665922+0000","last_clean":"2023-09-23T08:24:39.665922+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:24:39.665922+0000","last_undegraded":"2023-09-23T08:24:39.665922+0000","last_fullsized":"2023-09-23T08:24:39.665922+0000","mapping_epoch":13,"log_start":"78'244704","ondisk_log_start":"78'244704","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":280,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 118s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2747310614,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":245936,"num_read_kb":964107,"num_write":242664,"num_write_kb":970539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":250,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:23:41.921621+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:23:41.921621+0000","last_peered":"2023-09-23T08:23:41.921621+0000","last_clean":"2023-09-23T08:23:41.921621+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:23:41.921621+0000","last_undegraded":"2023-09-23T08:23:41.921621+0000","last_fullsized":"2023-09-23T08:23:41.921621+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22640405291,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2012549,"num_read_kb":7897479,"num_write":1993120,"num_write_kb":7971505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16326680576,"data_stored":20576695894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80435,"ondisk_log_size":80435,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4688968,"kb_used_data":2950400,"kb_used_omap":219,"kb_used_meta":1738340,"kb_avail":89682872,"statfs":{"total":96636764160,"available":91835260928,"internally_reserved":0,"allocated":3021209600,"data_stored":3799171506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1780061005},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,4,2,8,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":0.95499999999999996,"15min":0.67400000000000004},"min":{"1min":0.185,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":9.2750000000000004,"5min":9.2750000000000004,"15min":9.2750000000000004},"last":2.9950000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90100000000000002,"15min":1.0229999999999999},"min":{"1min":0.224,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":6.9279999999999999,"5min":8.2629999999999999,"15min":25.483000000000001},"last":2.9670000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":1.0940000000000001,"15min":0.85399999999999998},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.215},"max":{"1min":3.3650000000000002,"5min":11.65,"15min":25.550000000000001},"last":2.9329999999999998},{"interface":"front","average":{"1min":1.9079999999999999,"5min":1.242,"15min":0.879},"min":{"1min":0.23999999999999999,"5min":0.182,"15min":0.182},"max":{"1min":10.013,"5min":10.013,"15min":10.013},"last":6.9669999999999996}]}]},{"osd":1,"up_from":8,"seq":34359739175,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9177992,"kb_used_data":7969152,"kb_used_omap":605,"kb_used_meta":1208226,"kb_avail":85193848,"statfs":{"total":96636764160,"available":87238500352,"internally_reserved":0,"allocated":8160411648,"data_stored":10285558244,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":1237223796},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,2,0,7,8,9,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.749,"15min":0.72599999999999998},"min":{"1min":0.25600000000000001,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":0.81999999999999995,"5min":10.25,"15min":10.25},"last":0.28100000000000003},{"interface":"front","average":{"1min":2.0190000000000001,"5min":1.458,"15min":0.995},"min":{"1min":0.25700000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":14.914,"5min":15.291,"15min":15.291},"last":0.18099999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.89600000000000002,"15min":0.89900000000000002},"min":{"1min":0.26000000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.915,"5min":11.545,"15min":12.074999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.79200000000000004,"15min":0.86399999999999999},"min":{"1min":0.28000000000000003,"5min":0.23999999999999999,"15min":0.23599999999999999},"max":{"1min":1.1919999999999999,"5min":11.577999999999999,"15min":12.269},"last":0.251}]}]},{"osd":0,"up_from":8,"seq":34359739182,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6917728,"kb_used_data":5024728,"kb_used_omap":377,"kb_used_meta":1892614,"kb_avail":87454112,"statfs":{"total":96636764160,"available":89553010688,"internally_reserved":0,"allocated":5145321472,"data_stored":6492112075,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":1938037517},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,0,1,2,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.6279999999999999,"15min":1.5700000000000001},"min":{"1min":0.186,"5min":0.17000000000000001,"15min":0.16300000000000001},"max":{"1min":2.7650000000000001,"5min":21.207000000000001,"15min":21.207000000000001},"last":3.5550000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.99199999999999999,"15min":0.81399999999999995},"min":{"1min":0.27400000000000002,"5min":0.20300000000000001,"15min":0.19900000000000001},"max":{"1min":2.8010000000000002,"5min":20.436,"15min":20.436},"last":3.5950000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.219,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.747,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.97999999999999998,"15min":0.79000000000000004},"min":{"1min":0.218,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":2.9860000000000002,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.23899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5144862720,"data_stored":6491514386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8160845824,"data_stored":10285853483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3020972032,"data_stored":3799328025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:24:45.161 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:45.161 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:45.161 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:45.161 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:45.162 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:45.162 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:45.162 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:45.162 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:24:45.162 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:24:45.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:45.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:45.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:45.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:45.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:45.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:45.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:45.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:24:45.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:45.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:45.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:45.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:45.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:45.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:45.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:45.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:46.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:46.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:46.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:46.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:46.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:46.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:46.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:46.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:46.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:46.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:46.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:46.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:46.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:46.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:46.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:46.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:47.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:46.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:47.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:47.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:47.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:47.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:47.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:47.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:47.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:47.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:47.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:47.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:47.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:47.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:47.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:47.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:47.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:47.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:47.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:47.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:47.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:47.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:47.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:24:47.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:47.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:47.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:47.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:47.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:47.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:47.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:47.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:47.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:47.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:47.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:47.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:49.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:49.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:49.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:49.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:49.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:49.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:49.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:49.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:49.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:49.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:49.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:49.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:49.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:49.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:49.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:49.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:50.086 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:50.078+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:24:51.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:51.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:51.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:51.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:51.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:51.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:51.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:51.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:51.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:51.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:51.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:51.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:51.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:51.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:51.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:51.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:51.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:51.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:51.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:51.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:52.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:52.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:52.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:52.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:52.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:52.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:52.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:52.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:52.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:52.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:52.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:52.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:52.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:52.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:52.976 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:52.970+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:24:52.976 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:52.970+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:24:53.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:53.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:53.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:53.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:53.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:53.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:53.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:53.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:53.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:53.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:53.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:53.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:53.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:53.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:53.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:53.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:53.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:53.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:54.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:54.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:54.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:54.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:54.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:54.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:54.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:54.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:54.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:54.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:54.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:54.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:55.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:24:55.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:55.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:24:55.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:55.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:55.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:55.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:55.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:55.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:55.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:55.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:55.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:55.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:55.487 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:55.474+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:24:55.487 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:55.474+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:24:55.487 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:55.474+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:24:56.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:56.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:56.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:56.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:56.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:56.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:56.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:56.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:56.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:56.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:56.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:56.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:56.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:56.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:57.117 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:24:57.110+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:24:57.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:57.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:57.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:57.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:57.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:57.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:24:57.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:57.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:57.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:57.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:57.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:57.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:57.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:57.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:57.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:57.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:57.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:57.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:58.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:58.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:24:58.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:58.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:24:58.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:58.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:24:58.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:58.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:24:58.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:58.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:24:58.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:58.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:24:58.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:58.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:24:58.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:58.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:24:58.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:24:58.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:24:58.987 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:58.982+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:24:58.987 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:58.982+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:24:58.987 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:24:58.982+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:02.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:02.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:02.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:02.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:02.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:02.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:02.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:02.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:02.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:02.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:02.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:02.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:02.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:02.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:02.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:02.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:03.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:03.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:03.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:03.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:03.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:03.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:03.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:03.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:03.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:03.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:03.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:03.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:03.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:03.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:03.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:04.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:04.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:25:04.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:04.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:04.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:04.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:04.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:04.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:04.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:04.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:04.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:04.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:04.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:04.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:04.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:04.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:05.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:05.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:05.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:05.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:05.164 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:25:05.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:05.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:05.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:05.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:05.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:05.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:05.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:05.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:05.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:05.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:05.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:05.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:06.270 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:25:06.270 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:25:06.312 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2130,"stamp":"2023-09-23T08:25:04.274268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22671387979,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2021193,"num_read_kb":7931646,"num_write":2001966,"num_write_kb":8008235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80556,"ondisk_log_size":80556,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21116964,"kb_used_data":16014212,"kb_used_omap":1202,"kb_used_meta":5101517,"kb_avail":261998556,"statfs":{"total":289910292480,"available":268286521344,"internally_reserved":0,"allocated":16398553088,"data_stored":20648438045,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1230898,"internal_metadata":5223954382},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,3,1,12,19,16,19,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18292736,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5022,"num_read_kb":20024,"num_write":5241,"num_write_kb":20964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004257"},"pg_stats":[{"pgid":"2.7","version":"81'248548","reported_seq":488595,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:00.266845+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:25:00.266845+0000","last_peered":"2023-09-23T08:25:00.266845+0000","last_clean":"2023-09-23T08:25:00.266845+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:25:00.266845+0000","last_undegraded":"2023-09-23T08:25:00.266845+0000","last_fullsized":"2023-09-23T08:25:00.266845+0000","mapping_epoch":13,"log_start":"78'238510","ondisk_log_start":"78'238510","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2675319119,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":239826,"num_read_kb":941218,"num_write":236586,"num_write_kb":946248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"81'272906","reported_seq":536916,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:00.207204+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:25:00.207204+0000","last_peered":"2023-09-23T08:25:00.207204+0000","last_clean":"2023-09-23T08:25:00.207204+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:25:00.207204+0000","last_undegraded":"2023-09-23T08:25:00.207204+0000","last_fullsized":"2023-09-23T08:25:00.207204+0000","mapping_epoch":13,"log_start":"78'262807","ondisk_log_start":"78'262807","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2980548927,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":264559,"num_read_kb":1034198,"num_write":260976,"num_write_kb":1043673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"81'258983","reported_seq":508042,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:00.241890+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:25:00.241890+0000","last_peered":"2023-09-23T08:25:00.241890+0000","last_clean":"2023-09-23T08:25:00.241890+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:25:00.241890+0000","last_undegraded":"2023-09-23T08:25:00.241890+0000","last_fullsized":"2023-09-23T08:25:00.241890+0000","mapping_epoch":13,"log_start":"78'248909","ondisk_log_start":"78'248909","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2781925676,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":248820,"num_read_kb":976409,"num_write":247037,"num_write_kb":988061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"81'263306","reported_seq":526766,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:00.220770+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:25:00.220770+0000","last_peered":"2023-09-23T08:25:00.220770+0000","last_clean":"2023-09-23T08:25:00.220770+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:25:00.220770+0000","last_undegraded":"2023-09-23T08:25:00.220770+0000","last_fullsized":"2023-09-23T08:25:00.220770+0000","mapping_epoch":13,"log_start":"78'253207","ondisk_log_start":"78'253207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2975387930,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":264111,"num_read_kb":1042431,"num_write":262518,"num_write_kb":1049985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"81'256657","reported_seq":512199,"reported_epoch":81,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:25:02.353837+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:25:02.353837+0000","last_peered":"2023-09-23T08:25:02.353837+0000","last_clean":"2023-09-23T08:25:02.353837+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:25:02.353837+0000","last_undegraded":"2023-09-23T08:25:02.353837+0000","last_fullsized":"2023-09-23T08:25:02.353837+0000","mapping_epoch":13,"log_start":"78'246607","ondisk_log_start":"78'246607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":411,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 145s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2869911870,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":255629,"num_read_kb":1003439,"num_write":253996,"num_write_kb":1015834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"81'265018","reported_seq":526560,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:03.534710+0000","last_change":"2023-09-23T08:25:01.092075+0000","last_active":"2023-09-23T08:25:03.534710+0000","last_peered":"2023-09-23T08:25:03.534710+0000","last_clean":"2023-09-23T08:25:03.534710+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:25:03.534710+0000","last_undegraded":"2023-09-23T08:25:03.534710+0000","last_fullsized":"2023-09-23T08:25:03.534710+0000","mapping_epoch":13,"log_start":"78'255011","ondisk_log_start":"78'255011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2954445270,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":261430,"num_read_kb":1025320,"num_write":259614,"num_write_kb":1038336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"81'242974","reported_seq":483030,"reported_epoch":81,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:25:03.508564+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:25:03.508564+0000","last_peered":"2023-09-23T08:25:03.508564+0000","last_clean":"2023-09-23T08:25:03.508564+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:25:03.508564+0000","last_undegraded":"2023-09-23T08:25:03.508564+0000","last_fullsized":"2023-09-23T08:25:03.508564+0000","mapping_epoch":13,"log_start":"78'232908","ondisk_log_start":"78'232908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":422,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 142s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2682327341,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":239699,"num_read_kb":940129,"num_write":237368,"num_write_kb":949385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"81'255929","reported_seq":503124,"reported_epoch":81,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:25:00.242384+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:25:00.242384+0000","last_peered":"2023-09-23T08:25:00.242384+0000","last_clean":"2023-09-23T08:25:00.242384+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:25:00.242384+0000","last_undegraded":"2023-09-23T08:25:00.242384+0000","last_fullsized":"2023-09-23T08:25:00.242384+0000","mapping_epoch":13,"log_start":"78'245905","ondisk_log_start":"78'245905","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":344,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 139s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2750931478,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":247013,"num_read_kb":968411,"num_write":243734,"num_write_kb":974819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":251,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:14.159978+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:24:14.159978+0000","last_peered":"2023-09-23T08:24:14.159978+0000","last_clean":"2023-09-23T08:24:14.159978+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:24:14.159978+0000","last_undegraded":"2023-09-23T08:24:14.159978+0000","last_fullsized":"2023-09-23T08:24:14.159978+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22670797611,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2021087,"num_read_kb":7931555,"num_write":2001829,"num_write_kb":8006341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16397463552,"data_stored":20647478870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80457,"ondisk_log_size":80457,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739190,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4738696,"kb_used_data":2963584,"kb_used_omap":219,"kb_used_meta":1774884,"kb_avail":89633144,"statfs":{"total":96636764160,"available":91784339456,"internally_reserved":0,"allocated":3034710016,"data_stored":3812667206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1817482061},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,3,5,7,7,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.88100000000000001,"15min":0.67700000000000005},"min":{"1min":0.189,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":2.9950000000000001,"5min":9.2750000000000004,"15min":9.2750000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":1.0129999999999999},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.4299999999999997,"5min":8.2629999999999999,"15min":25.483000000000001},"last":0.36899999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.159,"15min":0.85999999999999999},"min":{"1min":0.27300000000000002,"5min":0.219,"15min":0.215},"max":{"1min":6.9870000000000001,"5min":11.65,"15min":25.550000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":3.2280000000000002,"5min":1.6910000000000001,"15min":1.0469999999999999},"min":{"1min":0.19800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":13.914,"5min":13.914,"15min":13.914},"last":0.27400000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739179,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9374724,"kb_used_data":8004788,"kb_used_omap":605,"kb_used_meta":1369314,"kb_avail":84997116,"statfs":{"total":96636764160,"available":87037046784,"internally_reserved":0,"allocated":8196902912,"data_stored":10322044792,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":1402177908},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,0,6,11,6,7,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.79600000000000004,"15min":0.71399999999999997},"min":{"1min":0.22800000000000001,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":7.5789999999999997,"5min":10.25,"15min":10.25},"last":0.17699999999999999},{"interface":"front","average":{"1min":2.5030000000000001,"5min":1.8049999999999999,"15min":1.093},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":11.390000000000001,"5min":15.291,"15min":15.291},"last":0.27400000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.97399999999999998,"15min":0.86399999999999999},"min":{"1min":0.224,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":3.4220000000000002,"5min":11.545,"15min":12.074999999999999},"last":0.37},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.78300000000000003,"15min":0.80400000000000005},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.6200000000000001,"5min":11.577999999999999,"15min":12.269},"last":0.20100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739186,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7003544,"kb_used_data":5045840,"kb_used_omap":377,"kb_used_meta":1957318,"kb_avail":87368296,"statfs":{"total":96636764160,"available":89465135104,"internally_reserved":0,"allocated":5166940160,"data_stored":6513726047,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":2004294413},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,1,3,3,3,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.4630000000000001,"15min":1.514},"min":{"1min":0.17799999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":6.2409999999999997,"5min":21.207000000000001,"15min":21.207000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.125,"15min":0.85499999999999998},"min":{"1min":0.249,"5min":0.22500000000000001,"15min":0.20300000000000001},"max":{"1min":6.3090000000000002,"5min":20.436,"15min":20.436},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.219,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.747,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.97999999999999998,"15min":0.79000000000000004},"min":{"1min":0.218,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":2.9860000000000002,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.47299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5166645248,"data_stored":6513296914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8196440064,"data_stored":10321447723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3034378240,"data_stored":3812734233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:25:06.314 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:06.314 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:06.314 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:06.314 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:06.315 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:06.315 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:06.315 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:06.315 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:06.315 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-09-23T08:25:07.152 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-09-23T08:25:07.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:07.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:07.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:07.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-09-23T08:25:07.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:07.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:07.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:07.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:07.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:07.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:07.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:07.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:07.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:07.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:07.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:07.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:07.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:07.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:07.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:07.954 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-09-23T08:25:08.003 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-09-23T08:25:08.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:08.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:08.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:08.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:08.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:08.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:08.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:08.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:08.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:08.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:08.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:08.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:08.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:08.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:08.995 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-09-23T08:25:09.038 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-09-23T08:25:09.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:09.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:09.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:09.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:09.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:09.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:09.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:09.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:09.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:09.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:09.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:09.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:09.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:09.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:09.799 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-09-23T08:25:09.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:09.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:09.840 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-09-23T08:25:10.703 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-09-23T08:25:10.757 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-09-23T08:25:11.058 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:11.050+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:25:11.078 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:11.070+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:11.091 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:11.086+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:11.474 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-09-23T08:25:11.502 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-09-23T08:25:11.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:11.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:11.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:11.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:11.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:11.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:11.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:11.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:11.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:11.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:12.364 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-09-23T08:25:12.427 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-09-23T08:25:12.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:12.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:12.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:12.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:12.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:12.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:12.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:12.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:12.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:12.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:12.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:12.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:12.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:12.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:12.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:12.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:12.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:13.208 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-09-23T08:25:13.321 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:25:14.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:14.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:14.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:14.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:14.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:14.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:14.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:14.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:14.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:14.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:14.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:14.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:15.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:25:15.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:15.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:25:15.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:15.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:15.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:15.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:15.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:15.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:15.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:15.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:15.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:15.812 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:15.806+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:15.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:16.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:15.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:16.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:16.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:16.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:16.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:16.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:16.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:16.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:16.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:16.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:16.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:16.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:16.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:16.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:16.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:17.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:17.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:17.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:17.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:17.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:17.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:17.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:17.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:17.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:17.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:17.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:17.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:17.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:17.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:20.482 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:20.474+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:25:20.482 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:20.474+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:20.482 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:20.474+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:20.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:20.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:20.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:20.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:20.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:20.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:20.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:20.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:20.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:20.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:20.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:20.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:20.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:20.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:20.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:20.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:20.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:20.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:20.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:20.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:22.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:22.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:22.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:22.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:22.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:22.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:22.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:22.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:22.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:22.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:22.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:22.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:22.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:22.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:23.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:25:23.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:23.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:23.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:23.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:23.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:23.851 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:23.842+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:25:23.851 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:23.842+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:25:23.851 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:23.842+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:25:23.851 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:23.842+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:25:23.851 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:23.842+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:23.851 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:23.842+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:23.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:23.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:23.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:23.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:23.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:23.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:24.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:24.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:24.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:24.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:24.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:24.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:24.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:24.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:24.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:24.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:24.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:24.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:24.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:24.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:25.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:25.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:25.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:25.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:25.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:25.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:25.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:25.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:25.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:25.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:25.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:25.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:25.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:25.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:25.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:25.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:26.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:26.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:26.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:26.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:26.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:26.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:26.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:26.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:26.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:26.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:26.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:26.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:26.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:26.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:26.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:26.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:27.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:27.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:27.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:27.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:27.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:27.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:27.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:27.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:27.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:27.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:27.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:27.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:27.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:27.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:27.164 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:27.154+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:25:27.164 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:27.154+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:27.164 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:27.154+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:28.956 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:28.950+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:28.956 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:28.950+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:30.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:25:30.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:30.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:25:30.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:30.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:30.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:30.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:30.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:30.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:30.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:30.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:30.876 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:30.870+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:30.876 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:30.870+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:30.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:30.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:31.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:31.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:31.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:31.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:31.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:31.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:31.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:31.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:31.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:31.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:31.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:31.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:31.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:31.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:31.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:31.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:33.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:33.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:33.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:33.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:33.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:33.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:33.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:33.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:33.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:33.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:33.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:33.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:33.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:33.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:33.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:25:34.022 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:25:34.023 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:25:34.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:34.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:34.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:34.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:34.103 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2144,"stamp":"2023-09-23T08:25:32.285324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22712962379,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2033822,"num_read_kb":7982086,"num_write":2013895,"num_write_kb":8055951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80383,"ondisk_log_size":80383,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21536720,"kb_used_data":16107060,"kb_used_omap":1202,"kb_used_meta":5428429,"kb_avail":261578800,"statfs":{"total":289910292480,"available":267856691200,"internally_reserved":0,"allocated":16493629440,"data_stored":20743514397,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1230898,"internal_metadata":5558712270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,7,6,11,5,13,19],"upper_bound":256},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19922944,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6045,"num_read_kb":24120,"num_write":5729,"num_write_kb":22916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002007"},"pg_stats":[{"pgid":"2.7","version":"81'249926","reported_seq":491467,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:30.903589+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:25:30.903589+0000","last_peered":"2023-09-23T08:25:30.903589+0000","last_clean":"2023-09-23T08:25:30.903589+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:25:30.903589+0000","last_undegraded":"2023-09-23T08:25:30.903589+0000","last_fullsized":"2023-09-23T08:25:30.903589+0000","mapping_epoch":13,"log_start":"78'239910","ondisk_log_start":"78'239910","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2679976271,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":241300,"num_read_kb":947102,"num_write":237883,"num_write_kb":951436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"81'274760","reported_seq":540567,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:30.919525+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:25:30.919525+0000","last_peered":"2023-09-23T08:25:30.919525+0000","last_clean":"2023-09-23T08:25:30.919525+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:25:30.919525+0000","last_undegraded":"2023-09-23T08:25:30.919525+0000","last_fullsized":"2023-09-23T08:25:30.919525+0000","mapping_epoch":13,"log_start":"79'264707","ondisk_log_start":"79'264707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2987172159,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":266338,"num_read_kb":1041302,"num_write":262749,"num_write_kb":1050765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"81'260605","reported_seq":511255,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:30.868413+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:25:30.868413+0000","last_peered":"2023-09-23T08:25:30.868413+0000","last_clean":"2023-09-23T08:25:30.868413+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:25:30.868413+0000","last_undegraded":"2023-09-23T08:25:30.868413+0000","last_fullsized":"2023-09-23T08:25:30.868413+0000","mapping_epoch":13,"log_start":"78'250509","ondisk_log_start":"78'250509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2787221804,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":250399,"num_read_kb":982717,"num_write":248578,"num_write_kb":994225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"81'265011","reported_seq":530235,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:30.915434+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:25:30.915434+0000","last_peered":"2023-09-23T08:25:30.915434+0000","last_clean":"2023-09-23T08:25:30.915434+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:25:30.915434+0000","last_undegraded":"2023-09-23T08:25:30.915434+0000","last_fullsized":"2023-09-23T08:25:30.915434+0000","mapping_epoch":13,"log_start":"79'255007","ondisk_log_start":"79'255007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2981232922,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":265871,"num_read_kb":1049467,"num_write":264223,"num_write_kb":1056805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"81'257913","reported_seq":514744,"reported_epoch":81,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:25:27.493396+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:25:27.493396+0000","last_peered":"2023-09-23T08:25:27.493396+0000","last_clean":"2023-09-23T08:25:27.493396+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:25:27.493396+0000","last_undegraded":"2023-09-23T08:25:27.493396+0000","last_fullsized":"2023-09-23T08:25:27.493396+0000","mapping_epoch":13,"log_start":"78'247907","ondisk_log_start":"78'247907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":514,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 170s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2874233150,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":256898,"num_read_kb":1008515,"num_write":255166,"num_write_kb":1020514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"81'266516","reported_seq":529635,"reported_epoch":81,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:25:28.930904+0000","last_change":"2023-09-23T08:25:28.907396+0000","last_active":"2023-09-23T08:25:28.930904+0000","last_peered":"2023-09-23T08:25:28.930904+0000","last_clean":"2023-09-23T08:25:28.930904+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:25:28.930904+0000","last_undegraded":"2023-09-23T08:25:28.930904+0000","last_fullsized":"2023-09-23T08:25:28.930904+0000","mapping_epoch":13,"log_start":"78'256511","ondisk_log_start":"78'256511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2959454678,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":262983,"num_read_kb":1031520,"num_write":261076,"num_write_kb":1044184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"81'244367","reported_seq":485818,"reported_epoch":81,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:25:28.889397+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:25:28.889397+0000","last_peered":"2023-09-23T08:25:28.889397+0000","last_clean":"2023-09-23T08:25:28.889397+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:25:28.889397+0000","last_undegraded":"2023-09-23T08:25:28.889397+0000","last_fullsized":"2023-09-23T08:25:28.889397+0000","mapping_epoch":13,"log_start":"78'234308","ondisk_log_start":"78'234308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":498,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 168s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2686918957,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":241065,"num_read_kb":945569,"num_write":238668,"num_write_kb":954585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"81'257750","reported_seq":506826,"reported_epoch":81,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:25:30.914072+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:25:30.914072+0000","last_peered":"2023-09-23T08:25:30.914072+0000","last_clean":"2023-09-23T08:25:30.914072+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:25:30.914072+0000","last_undegraded":"2023-09-23T08:25:30.914072+0000","last_fullsized":"2023-09-23T08:25:30.914072+0000","mapping_epoch":13,"log_start":"79'247705","ondisk_log_start":"79'247705","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":420,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 169s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2756162070,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":248862,"num_read_kb":975803,"num_write":245415,"num_write_kb":981543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":251,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:14.159978+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:24:14.159978+0000","last_peered":"2023-09-23T08:24:14.159978+0000","last_clean":"2023-09-23T08:24:14.159978+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:24:14.159978+0000","last_undegraded":"2023-09-23T08:24:14.159978+0000","last_fullsized":"2023-09-23T08:24:14.159978+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22712372011,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2033716,"num_read_kb":7981995,"num_write":2013758,"num_write_kb":8054057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16492998656,"data_stored":20743013974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80284,"ondisk_log_size":80284,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739195,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4827916,"kb_used_data":2980612,"kb_used_omap":219,"kb_used_meta":1847076,"kb_avail":89543924,"statfs":{"total":96636764160,"available":91692978176,"internally_reserved":0,"allocated":3052146688,"data_stored":3830103878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1891406669},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,3,3,5,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.88100000000000001,"15min":0.67700000000000005},"min":{"1min":0.189,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":2.9950000000000001,"5min":9.2750000000000004,"15min":9.2750000000000004},"last":1.7290000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":1.0129999999999999},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.4299999999999997,"5min":8.2629999999999999,"15min":25.483000000000001},"last":1.7629999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.159,"15min":0.85999999999999999},"min":{"1min":0.27300000000000002,"5min":0.219,"15min":0.215},"max":{"1min":6.9870000000000001,"5min":11.65,"15min":25.550000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":3.2280000000000002,"5min":1.6910000000000001,"15min":1.0469999999999999},"min":{"1min":0.19800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":13.914,"5min":13.914,"15min":13.914},"last":0.33900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739185,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9609580,"kb_used_data":8055012,"kb_used_omap":605,"kb_used_meta":1553954,"kb_avail":84762260,"statfs":{"total":96636764160,"available":86796554240,"internally_reserved":0,"allocated":8248332288,"data_stored":10373474168,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":1591249268},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,7,1,5,2,8,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.79600000000000004,"15min":0.71399999999999997},"min":{"1min":0.22800000000000001,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":7.5789999999999997,"5min":10.25,"15min":10.25},"last":0.23799999999999999},{"interface":"front","average":{"1min":2.5030000000000001,"5min":1.8049999999999999,"15min":1.093},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":11.390000000000001,"5min":15.291,"15min":15.291},"last":0.309}]},{"osd":2,"last update":"Sat Sep 23 08:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.97399999999999998,"15min":0.86399999999999999},"min":{"1min":0.224,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":3.4220000000000002,"5min":11.545,"15min":12.074999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.78300000000000003,"15min":0.80400000000000005},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.6200000000000001,"5min":11.577999999999999,"15min":12.269},"last":0.374}]}]},{"osd":0,"up_from":8,"seq":34359739191,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7099224,"kb_used_data":5071436,"kb_used_omap":377,"kb_used_meta":2027398,"kb_avail":87272616,"statfs":{"total":96636764160,"available":89367158784,"internally_reserved":0,"allocated":5193150464,"data_stored":6539936351,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":386291,"internal_metadata":2076056333},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,3,0,0,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.4630000000000001,"15min":1.514},"min":{"1min":0.17799999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":6.2409999999999997,"5min":21.207000000000001,"15min":21.207000000000001},"last":1.8899999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.125,"15min":0.85499999999999998},"min":{"1min":0.249,"5min":0.22500000000000001,"15min":0.20300000000000001},"max":{"1min":6.3090000000000002,"5min":20.436,"15min":20.436},"last":1.931}]},{"osd":2,"last update":"Sat Sep 23 08:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.219,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.747,"5min":15.039999999999999,"15min":15.039999999999999},"last":1.909},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.97999999999999998,"15min":0.79000000000000004},"min":{"1min":0.218,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":2.9860000000000002,"5min":21.757999999999999,"15min":21.757999999999999},"last":0.28399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5192568832,"data_stored":6539220498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8248926208,"data_stored":10373933867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3051503616,"data_stored":3829859609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:25:34.104 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:34.104 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:34.105 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:34.105 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:34.105 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:34.105 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:34.105 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:34.105 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:34.106 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:25:34.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:34.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:34.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:34.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:34.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:34.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:34.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:34.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:34.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:34.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:34.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:34.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:34.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:34.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:35.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:35.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:35.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:35.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:35.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:35.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:35.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:35.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:35.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:35.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:35.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:35.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:35.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:35.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:35.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:35.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:35.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:35.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:36.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:36.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:36.597 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:25:36.590+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:25:36.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:36.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:36.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:36.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:36.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:36.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:36.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:36.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:36.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:36.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:36.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:36.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:37.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:37.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:37.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:37.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:37.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:37.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:37.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:37.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:37.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:37.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:37.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:37.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:37.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:37.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:37.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:37.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:39.092 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:39.086+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:42.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:42.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:42.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:42.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:43.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:43.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:43.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:43.036 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:43.034+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:43.051 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:43.034+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:43.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:43.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:43.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:43.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:43.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:43.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:43.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:43.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:43.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:43.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:43.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:43.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:43.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:43.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:43.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:43.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:43.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:43.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:44.180 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:44.178+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:25:44.180 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:44.178+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:25:44.180 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:44.178+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:25:44.198 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:44.194+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:25:44.198 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:44.194+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:44.198 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:44.194+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:45.369 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:45.366+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:45.370 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:45.366+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:47.541 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:47.538+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:47.542 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:47.538+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:47.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:47.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:25:47.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:47.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:47.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:47.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:47.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:47.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:47.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:47.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:47.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:47.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:47.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:47.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:47.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:47.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:47.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:47.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:47.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:47.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:48.242 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:48.238+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:48.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:48.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:48.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:48.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:48.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:48.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:48.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:48.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:48.532 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:48.530+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:48.532 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:48.530+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:48.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:48.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:48.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:48.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:48.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:48.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:49.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:49.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:49.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:49.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:49.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:49.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:49.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:49.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:49.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:49.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:49.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:49.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:49.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:49.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:50.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:50.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:50.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:25:50.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:50.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:25:50.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:50.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:50.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:50.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:50.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:50.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:50.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:50.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:50.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:25:50.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:50.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:25:50.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:50.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:50.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:50.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:50.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:50.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:50.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:50.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:50.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:50.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:50.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:50.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:50.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:50.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:50.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:50.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:50.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:50.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:50.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:50.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:50.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:50.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:50.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:50.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:51.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:50.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:51.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:51.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:51.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:51.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:51.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:51.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:51.232 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:51.230+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:25:51.232 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:51.230+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:25:51.240 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:51.230+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:25:51.240 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:51.230+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:51.240 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:51.230+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:51.389 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:51.386+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:25:51.389 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:25:51.386+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:25:52.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:52.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:52.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:52.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:52.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:52.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:52.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:52.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:52.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:52.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:52.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:52.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:52.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:52.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:52.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:52.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:54.106 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:25:54.723 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:25:54.724 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:25:54.799 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2155,"stamp":"2023-09-23T08:25:54.288863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22745718091,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2043439,"num_read_kb":8020466,"num_write":2023319,"num_write_kb":8093647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80379,"ondisk_log_size":80379,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21557092,"kb_used_data":16184460,"kb_used_omap":1203,"kb_used_meta":5371404,"kb_avail":261558428,"statfs":{"total":289910292480,"available":267835830272,"internally_reserved":0,"allocated":16572887040,"data_stored":20822771997,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1232578,"internal_metadata":5500318014},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2,0,3,24,41,11,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17534976,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4974,"num_read_kb":19844,"num_write":5033,"num_write_kb":20132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001855"},"pg_stats":[{"pgid":"2.7","version":"81'250886","reported_seq":493417,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:51.381191+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:25:51.381191+0000","last_peered":"2023-09-23T08:25:51.381191+0000","last_clean":"2023-09-23T08:25:51.381191+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:25:51.381191+0000","last_undegraded":"2023-09-23T08:25:51.381191+0000","last_fullsized":"2023-09-23T08:25:51.381191+0000","mapping_epoch":13,"log_start":"79'240810","ondisk_log_start":"79'240810","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2682990927,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":242279,"num_read_kb":951014,"num_write":238788,"num_write_kb":955056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"81'275965","reported_seq":542936,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:51.346363+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:25:51.346363+0000","last_peered":"2023-09-23T08:25:51.346363+0000","last_clean":"2023-09-23T08:25:51.346363+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:25:51.346363+0000","last_undegraded":"2023-09-23T08:25:51.346363+0000","last_fullsized":"2023-09-23T08:25:51.346363+0000","mapping_epoch":13,"log_start":"79'265907","ondisk_log_start":"79'265907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2991444287,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":267490,"num_read_kb":1045886,"num_write":263900,"num_write_kb":1055369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"81'261614","reported_seq":513258,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:51.306338+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:25:51.306338+0000","last_peered":"2023-09-23T08:25:51.306338+0000","last_clean":"2023-09-23T08:25:51.306338+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:25:51.306338+0000","last_undegraded":"2023-09-23T08:25:51.306338+0000","last_fullsized":"2023-09-23T08:25:51.306338+0000","mapping_epoch":13,"log_start":"79'251609","ondisk_log_start":"79'251609","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2790596908,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":251378,"num_read_kb":986633,"num_write":249533,"num_write_kb":998045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"81'266256","reported_seq":532719,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:51.324741+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:25:51.324741+0000","last_peered":"2023-09-23T08:25:51.324741+0000","last_clean":"2023-09-23T08:25:51.324741+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:25:51.324741+0000","last_undegraded":"2023-09-23T08:25:51.324741+0000","last_fullsized":"2023-09-23T08:25:51.324741+0000","mapping_epoch":13,"log_start":"79'256207","ondisk_log_start":"79'256207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2985562394,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":267110,"num_read_kb":1054419,"num_write":265468,"num_write_kb":1061785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"81'259234","reported_seq":517365,"reported_epoch":81,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:25:52.695752+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:25:52.695752+0000","last_peered":"2023-09-23T08:25:52.695752+0000","last_clean":"2023-09-23T08:25:52.695752+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:25:52.695752+0000","last_undegraded":"2023-09-23T08:25:52.695752+0000","last_fullsized":"2023-09-23T08:25:52.695752+0000","mapping_epoch":13,"log_start":"79'249207","ondisk_log_start":"79'249207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":586,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 195s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2878738750,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":258168,"num_read_kb":1013583,"num_write":256428,"num_write_kb":1025562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"81'268051","reported_seq":532649,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:25:54.178817+0000","last_change":"2023-09-23T08:25:49.031685+0000","last_active":"2023-09-23T08:25:54.178817+0000","last_peered":"2023-09-23T08:25:54.178817+0000","last_clean":"2023-09-23T08:25:54.178817+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:25:54.178817+0000","last_undegraded":"2023-09-23T08:25:54.178817+0000","last_fullsized":"2023-09-23T08:25:54.178817+0000","mapping_epoch":13,"log_start":"79'258011","ondisk_log_start":"79'258011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2964734422,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":264441,"num_read_kb":1037328,"num_write":262569,"num_write_kb":1050156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"81'245715","reported_seq":488479,"reported_epoch":81,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:25:54.226436+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:25:54.226436+0000","last_peered":"2023-09-23T08:25:54.226436+0000","last_clean":"2023-09-23T08:25:54.226436+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:25:54.226436+0000","last_undegraded":"2023-09-23T08:25:54.226436+0000","last_fullsized":"2023-09-23T08:25:54.226436+0000","mapping_epoch":13,"log_start":"79'235708","ondisk_log_start":"79'235708","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":594,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 193s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2690859309,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":242358,"num_read_kb":950721,"num_write":239895,"num_write_kb":959493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"81'259023","reported_seq":509369,"reported_epoch":81,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:25:51.359170+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:25:51.359170+0000","last_peered":"2023-09-23T08:25:51.359170+0000","last_clean":"2023-09-23T08:25:51.359170+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:25:51.359170+0000","last_undegraded":"2023-09-23T08:25:51.359170+0000","last_fullsized":"2023-09-23T08:25:51.359170+0000","mapping_epoch":13,"log_start":"79'249005","ondisk_log_start":"79'249005","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":462,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 190s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2760200726,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":250109,"num_read_kb":980791,"num_write":246601,"num_write_kb":986287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":251,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-09-23T08:24:14.159978+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:24:14.159978+0000","last_peered":"2023-09-23T08:24:14.159978+0000","last_clean":"2023-09-23T08:24:14.159978+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:24:14.159978+0000","last_undegraded":"2023-09-23T08:24:14.159978+0000","last_fullsized":"2023-09-23T08:24:14.159978+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22745127723,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2043333,"num_read_kb":8020375,"num_write":2023182,"num_write_kb":8091753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16572174336,"data_stored":20822189654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80280,"ondisk_log_size":80280,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739200,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4902736,"kb_used_data":2997128,"kb_used_omap":219,"kb_used_meta":1905380,"kb_avail":89469104,"statfs":{"total":96636764160,"available":91616362496,"internally_reserved":0,"allocated":3069059072,"data_stored":3847016262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1951109965},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,0,2,1,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:25:00 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.88100000000000001,"15min":0.67700000000000005},"min":{"1min":0.189,"5min":0.17999999999999999,"15min":0.17899999999999999},"max":{"1min":2.9950000000000001,"5min":9.2750000000000004,"15min":9.2750000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":1.0129999999999999},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":4.4299999999999997,"5min":8.2629999999999999,"15min":25.483000000000001},"last":0.749}]},{"osd":1,"last update":"Sat Sep 23 08:25:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.159,"15min":0.85999999999999999},"min":{"1min":0.27300000000000002,"5min":0.219,"15min":0.215},"max":{"1min":6.9870000000000001,"5min":11.65,"15min":25.550000000000001},"last":1.056},{"interface":"front","average":{"1min":3.2280000000000002,"5min":1.6910000000000001,"15min":1.0469999999999999},"min":{"1min":0.19800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":13.914,"5min":13.914,"15min":13.914},"last":4.968}]}]},{"osd":1,"up_from":8,"seq":34359739189,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9778372,"kb_used_data":8090684,"kb_used_omap":605,"kb_used_meta":1687074,"kb_avail":84593468,"statfs":{"total":96636764160,"available":86623711232,"internally_reserved":0,"allocated":8284860416,"data_stored":10410002296,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":1727564148},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,15,34,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.83699999999999997,"15min":0.71099999999999997},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.6929999999999996,"5min":10.25,"15min":10.25},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.9399999999999999,"15min":1.137},"min":{"1min":0.192,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.6980000000000004,"5min":15.291,"15min":15.291},"last":0.307}]},{"osd":2,"last update":"Sat Sep 23 08:25:50 2023","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":1.1200000000000001,"15min":0.90500000000000003},"min":{"1min":0.215,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":26.117000000000001,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.0800000000000001,"15min":0.85599999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":26.151,"5min":26.151,"15min":26.151},"last":0.36099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739196,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6875984,"kb_used_data":5096648,"kb_used_omap":378,"kb_used_meta":1778949,"kb_avail":87495856,"statfs":{"total":96636764160,"available":89595756544,"internally_reserved":0,"allocated":5218967552,"data_stored":6565753439,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":1821643901},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,2,7,6,3,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.95599999999999996,"15min":1.419},"min":{"1min":0.182,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.2770000000000001,"5min":8.7569999999999997,"15min":21.207000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.1459999999999999,"15min":0.88800000000000001},"min":{"1min":0.26700000000000002,"5min":0.22500000000000001,"15min":0.20300000000000001},"max":{"1min":2.3140000000000001,"5min":20.436,"15min":20.436},"last":0.38700000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81599999999999995,"15min":0.747},"min":{"1min":0.221,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":6.351,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.23899999999999999,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":6.2809999999999997,"5min":20.491,"15min":21.757999999999999},"last":0.27100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5219172352,"data_stored":6565824018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8284401664,"data_stored":10409409323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3068600320,"data_stored":3846956313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:25:54.800 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:54.801 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:54.801 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:54.801 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:54.801 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:54.801 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:54.801 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:54.802 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:25:54.802 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:25:55.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:55.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:55.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:55.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:55.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:55.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:55.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:55.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:55.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:55.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:55.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:55.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:56.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:56.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:56.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:56.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:56.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:56.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:56.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:56.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:25:56.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:25:56.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:56.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:56.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:56.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:56.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:56.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:56.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:56.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:25:56.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:25:56.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:56.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:56.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:56.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:56.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:56.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:56.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:56.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:56.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:25:57.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:57.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:25:57.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:57.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:25:57.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:57.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:25:57.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:57.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:25:57.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:57.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:25:57.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:57.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:25:57.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:57.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:25:57.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:25:57.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:03.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:03.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:03.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:03.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:03.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:03.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:03.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:03.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:03.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:03.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:03.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:03.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:03.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:03.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:04.797 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:04.793+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:26:04.797 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:04.793+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:26:04.798 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:04.793+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:26:06.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:06.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:06.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:06.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:06.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:06.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:06.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:06.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:06.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:06.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:06.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:06.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:06.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:06.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:06.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:06.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:06.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:06.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:06.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:06.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:06.780 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:06.777+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:26:06.780 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:06.777+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:26:06.780 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:06.777+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:26:07.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:07.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:07.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:07.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:07.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:07.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:07.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:07.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:07.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:07.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:07.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:07.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:07.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:07.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:07.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:07.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:07.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:07.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:07.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:07.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:08.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:08.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:08.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:08.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:08.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:08.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:08.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:08.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:08.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:08.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:26:08.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:08.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:08.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:08.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:08.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:08.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:08.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:08.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:08.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:08.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:10.177 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:10.169+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:26:10.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:10.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:10.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:10.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:10.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:10.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:10.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:10.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:10.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:10.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:10.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:10.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:10.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:10.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:10.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:10.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:10.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:10.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:10.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:10.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:11.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:26:11.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:11.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:11.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:11.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:11.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:11.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:11.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:11.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:11.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:11.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:11.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:12.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:26:12.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:12.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:12.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:12.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:12.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:12.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:12.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:12.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:12.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:12.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:12.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:13.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:13.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:13.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:13.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:13.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:13.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:13.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:13.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:13.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:13.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:13.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:13.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:13.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:13.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:13.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:14.212 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:14.209+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:26:14.212 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:14.209+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:26:14.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:26:15.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:15.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:15.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:15.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:15.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:15.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:15.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:15.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:15.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:15.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:15.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:15.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:15.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:15.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:15.794 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:26:15.795 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:26:15.835 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2166,"stamp":"2023-09-23T08:26:14.296196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22773415243,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2051841,"num_read_kb":8054022,"num_write":2031496,"num_write_kb":8126355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80569,"ondisk_log_size":80569,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21942104,"kb_used_data":16246912,"kb_used_omap":1203,"kb_used_meta":5693964,"kb_avail":261173416,"statfs":{"total":289910292480,"available":267441577984,"internally_reserved":0,"allocated":16636837888,"data_stored":20886184280,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1232578,"internal_metadata":5830619454},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,6,7,13,11,11,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12316672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3756,"num_read_kb":15000,"num_write":3733,"num_write_kb":14932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.005500"},"pg_stats":[{"pgid":"2.7","version":"82'251796","reported_seq":495279,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:11.808649+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:26:11.808649+0000","last_peered":"2023-09-23T08:26:11.808649+0000","last_clean":"2023-09-23T08:26:11.808649+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:26:11.808649+0000","last_undegraded":"2023-09-23T08:26:11.808649+0000","last_fullsized":"2023-09-23T08:26:11.808649+0000","mapping_epoch":13,"log_start":"79'241710","ondisk_log_start":"79'241710","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2685882703,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":243220,"num_read_kb":954774,"num_write":239652,"num_write_kb":958512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"82'277152","reported_seq":545290,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:11.776140+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:26:11.776140+0000","last_peered":"2023-09-23T08:26:11.776140+0000","last_clean":"2023-09-23T08:26:11.776140+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:26:11.776140+0000","last_undegraded":"2023-09-23T08:26:11.776140+0000","last_fullsized":"2023-09-23T08:26:11.776140+0000","mapping_epoch":13,"log_start":"79'267107","ondisk_log_start":"79'267107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2995466559,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":268646,"num_read_kb":1050494,"num_write":265042,"num_write_kb":1059937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"82'262629","reported_seq":515284,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:11.775918+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:26:11.775918+0000","last_peered":"2023-09-23T08:26:11.775918+0000","last_clean":"2023-09-23T08:26:11.775918+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:26:11.775918+0000","last_undegraded":"2023-09-23T08:26:11.775918+0000","last_fullsized":"2023-09-23T08:26:11.775918+0000","mapping_epoch":13,"log_start":"79'252609","ondisk_log_start":"79'252609","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2794062124,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":252376,"num_read_kb":990621,"num_write":250501,"num_write_kb":1001917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"82'267442","reported_seq":535113,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:11.760640+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:26:11.760640+0000","last_peered":"2023-09-23T08:26:11.760640+0000","last_clean":"2023-09-23T08:26:11.760640+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:26:11.760640+0000","last_undegraded":"2023-09-23T08:26:11.760640+0000","last_fullsized":"2023-09-23T08:26:11.760640+0000","mapping_epoch":13,"log_start":"79'257407","ondisk_log_start":"79'257407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2989768986,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":268318,"num_read_kb":1059251,"num_write":266654,"num_write_kb":1066529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"82'260461","reported_seq":519856,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:26:12.906318+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:26:12.906318+0000","last_peered":"2023-09-23T08:26:12.906318+0000","last_clean":"2023-09-23T08:26:12.906318+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:26:12.906318+0000","last_undegraded":"2023-09-23T08:26:12.906318+0000","last_fullsized":"2023-09-23T08:26:12.906318+0000","mapping_epoch":13,"log_start":"79'250407","ondisk_log_start":"79'250407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":626,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 215s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2882449726,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":259421,"num_read_kb":1018587,"num_write":257616,"num_write_kb":1030314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"82'268971","reported_seq":534437,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:09.433257+0000","last_change":"2023-09-23T08:26:09.213469+0000","last_active":"2023-09-23T08:26:09.433257+0000","last_peered":"2023-09-23T08:26:09.433257+0000","last_clean":"2023-09-23T08:26:09.433257+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:26:09.433257+0000","last_undegraded":"2023-09-23T08:26:09.433257+0000","last_fullsized":"2023-09-23T08:26:09.433257+0000","mapping_epoch":13,"log_start":"79'258911","ondisk_log_start":"79'258911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2967736790,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":265294,"num_read_kb":1040736,"num_write":263477,"num_write_kb":1053788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"82'246595","reported_seq":490167,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:26:09.420515+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:26:09.420515+0000","last_peered":"2023-09-23T08:26:09.420515+0000","last_clean":"2023-09-23T08:26:09.420515+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:26:09.420515+0000","last_undegraded":"2023-09-23T08:26:09.420515+0000","last_fullsized":"2023-09-23T08:26:09.420515+0000","mapping_epoch":13,"log_start":"79'236508","ondisk_log_start":"79'236508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":645,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 208s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2693476653,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":243143,"num_read_kb":953857,"num_write":240724,"num_write_kb":962809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"82'260188","reported_seq":511763,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:26:11.774324+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:26:11.774324+0000","last_peered":"2023-09-23T08:26:11.774324+0000","last_clean":"2023-09-23T08:26:11.774324+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:26:11.774324+0000","last_undegraded":"2023-09-23T08:26:11.774324+0000","last_fullsized":"2023-09-23T08:26:11.774324+0000","mapping_epoch":13,"log_start":"79'250105","ondisk_log_start":"79'250105","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":507,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 210s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2763981334,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":251317,"num_read_kb":985611,"num_write":247693,"num_write_kb":990655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":252,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-09-23T08:24:51.925847+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:24:51.925847+0000","last_peered":"2023-09-23T08:24:51.925847+0000","last_clean":"2023-09-23T08:24:51.925847+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:24:51.925847+0000","last_undegraded":"2023-09-23T08:24:51.925847+0000","last_fullsized":"2023-09-23T08:24:51.925847+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22772824875,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2051735,"num_read_kb":8053931,"num_write":2031359,"num_write_kb":8124461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16635600896,"data_stored":20885071446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80470,"ondisk_log_size":80470,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739203,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4960096,"kb_used_data":3006552,"kb_used_omap":219,"kb_used_meta":1953316,"kb_avail":89411744,"statfs":{"total":96636764160,"available":91557625856,"internally_reserved":0,"allocated":3078709248,"data_stored":3856596143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":2000196429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,4,1,3,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":0.92700000000000005,"15min":0.72999999999999998},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":10.922000000000001,"5min":10.922000000000001,"15min":10.922000000000001},"last":2.3559999999999999},{"interface":"front","average":{"1min":1.181,"5min":0.92600000000000005,"15min":1.0609999999999999},"min":{"1min":0.23000000000000001,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":10.954000000000001,"5min":10.954000000000001,"15min":25.483000000000001},"last":2.4350000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0569999999999999,"15min":0.90100000000000002},"min":{"1min":0.222,"5min":0.219,"15min":0.215},"max":{"1min":5.931,"5min":11.65,"15min":25.550000000000001},"last":2.3940000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.609,"15min":1.097},"min":{"1min":0.223,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":5.867,"5min":13.914,"15min":13.914},"last":0.24299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739193,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9984972,"kb_used_data":8123076,"kb_used_omap":605,"kb_used_meta":1861282,"kb_avail":84386868,"statfs":{"total":96636764160,"available":86412152832,"internally_reserved":0,"allocated":8318029824,"data_stored":10442921185,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":1905953140},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,6,6,2,8,6,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.83699999999999997,"15min":0.71099999999999997},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.6929999999999996,"5min":10.25,"15min":10.25},"last":0.22800000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.9399999999999999,"15min":1.137},"min":{"1min":0.192,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.6980000000000004,"5min":15.291,"15min":15.291},"last":0.25}]},{"osd":2,"last update":"Sat Sep 23 08:25:50 2023","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":1.1200000000000001,"15min":0.90500000000000003},"min":{"1min":0.215,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":26.117000000000001,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.0800000000000001,"15min":0.85599999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":26.151,"5min":26.151,"15min":26.151},"last":0.376}]}]},{"osd":0,"up_from":8,"seq":34359739200,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6997036,"kb_used_data":5117284,"kb_used_omap":378,"kb_used_meta":1879365,"kb_avail":87374804,"statfs":{"total":96636764160,"available":89471799296,"internally_reserved":0,"allocated":5240098816,"data_stored":6586666952,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":1924469885},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,7,2,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.95599999999999996,"15min":1.419},"min":{"1min":0.182,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.2770000000000001,"5min":8.7569999999999997,"15min":21.207000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.1459999999999999,"15min":0.88800000000000001},"min":{"1min":0.26700000000000002,"5min":0.22500000000000001,"15min":0.20300000000000001},"max":{"1min":2.3140000000000001,"5min":20.436,"15min":20.436},"last":0.373}]},{"osd":2,"last update":"Sat Sep 23 08:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81599999999999995,"15min":0.747},"min":{"1min":0.221,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":6.351,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.217},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.23899999999999999,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":6.2809999999999997,"5min":20.491,"15min":21.757999999999999},"last":0.40600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5239484416,"data_stored":6585923090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8317857792,"data_stored":10442599211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3078258688,"data_stored":3856549145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:26:15.836 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:15.836 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:15.836 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:15.837 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:15.837 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:15.837 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:15.837 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:15.837 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:15.838 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:26:18.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:18.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:18.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:18.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:18.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:18.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:18.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:18.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:18.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:18.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:26:18.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:18.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:18.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:18.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:18.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:18.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:18.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:18.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:18.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:18.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:18.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:18.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:19.341 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:19.337+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:26:19.341 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:19.337+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:26:19.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:19.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:19.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:19.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:19.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:19.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:19.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:19.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:19.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:19.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:19.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:19.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:19.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:19.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:20.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:26:20.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:20.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:20.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:20.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:20.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:20.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:20.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:20.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:20.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:20.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:20.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:20.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:22.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:22.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:22.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:22.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:22.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:22.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:22.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:22.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:22.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:22.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:22.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:22.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:22.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:22.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:22.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:22.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:22.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:22.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:22.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:22.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:23.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:23.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:23.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:23.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:23.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:23.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:23.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:23.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:23.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:23.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:23.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:23.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:23.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:23.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:23.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:23.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:23.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:23.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:24.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:24.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:24.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:24.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:24.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:24.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:24.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:24.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:24.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:24.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:24.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:24.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:24.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:24.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:25.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:25.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:25.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:25.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:25.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:25.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:25.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:25.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:25.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:25.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:25.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:25.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:25.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:25.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:25.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:25.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:25.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:25.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:25.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:25.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:27.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:27.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:27.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:27.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:27.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:27.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:27.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:27.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:27.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:27.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:27.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:27.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:27.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:27.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:27.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:27.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:27.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:27.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:28.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:26:28.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:28.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:28.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:28.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:28.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:28.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:28.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:28.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:28.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:28.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:28.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:28.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:26:28.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:28.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:28.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:28.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:28.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:28.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:28.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:28.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:28.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:28.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:28.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:28.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:28.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:28.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:29.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:29.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:29.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:29.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:29.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:29.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:29.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:29.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:29.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:29.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:29.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:29.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:29.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:29.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:29.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:29.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:30.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:30.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:30.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:30.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:30.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:30.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:30.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:30.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:30.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:30.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:30.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:30.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:30.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:30.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:30.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:30.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:30.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:30.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:31.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:31.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:31.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:31.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:31.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:31.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:31.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:31.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:31.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:31.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:31.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:31.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:31.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:31.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:31.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:31.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:31.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:31.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:33.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:33.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:33.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:33.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:33.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:33.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:33.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:33.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:33.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:33.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:33.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:33.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:33.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:33.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:33.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:33.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:34.578 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:34.573+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:26:34.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:34.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:34.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:34.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:34.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:34.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:34.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:34.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:34.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:34.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:34.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:34.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:34.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:34.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:34.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:34.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:34.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:34.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:35.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:35.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:35.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:35.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:35.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:35.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:35.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:35.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:35.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:35.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:35.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:35.841 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:26:35.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:35.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:35.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:35.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:35.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:35.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:35.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:35.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:35.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:35.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:35.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:35.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:35.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:36.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:36.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:36.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:36.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:36.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:36.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:36.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:36.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:36.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:36.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:36.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:36.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:36.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:36.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:36.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:36.755 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:26:36.755 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:26:36.833 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2177,"stamp":"2023-09-23T08:26:36.302593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22803463499,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2061058,"num_read_kb":8090802,"num_write":2040549,"num_write_kb":8162567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80506,"ondisk_log_size":80506,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21584880,"kb_used_data":16309784,"kb_used_omap":1203,"kb_used_meta":5273868,"kb_avail":261530640,"statfs":{"total":289910292480,"available":267807375360,"internally_reserved":0,"allocated":16701218816,"data_stored":20949557592,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1232578,"internal_metadata":5400441150},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,0,5,13,15,32,24,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16158720,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4932,"num_read_kb":19684,"num_write":4865,"num_write_kb":19460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002968"},"pg_stats":[{"pgid":"2.7","version":"82'252679","reported_seq":497033,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:32.227551+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:26:32.227551+0000","last_peered":"2023-09-23T08:26:32.227551+0000","last_clean":"2023-09-23T08:26:32.227551+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:26:32.227551+0000","last_undegraded":"2023-09-23T08:26:32.227551+0000","last_fullsized":"2023-09-23T08:26:32.227551+0000","mapping_epoch":13,"log_start":"79'242610","ondisk_log_start":"79'242610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2688541007,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":244076,"num_read_kb":958194,"num_write":240475,"num_write_kb":961804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"82'278399","reported_seq":547772,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:32.226529+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:26:32.226529+0000","last_peered":"2023-09-23T08:26:32.226529+0000","last_clean":"2023-09-23T08:26:32.226529+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:26:32.226529+0000","last_undegraded":"2023-09-23T08:26:32.226529+0000","last_fullsized":"2023-09-23T08:26:32.226529+0000","mapping_epoch":13,"log_start":"80'268307","ondisk_log_start":"80'268307","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":2999550271,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":269864,"num_read_kb":1055362,"num_write":266230,"num_write_kb":1064689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"82'263667","reported_seq":517311,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:32.181710+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:26:32.181710+0000","last_peered":"2023-09-23T08:26:32.181710+0000","last_clean":"2023-09-23T08:26:32.181710+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:26:32.181710+0000","last_undegraded":"2023-09-23T08:26:32.181710+0000","last_fullsized":"2023-09-23T08:26:32.181710+0000","mapping_epoch":13,"log_start":"79'253609","ondisk_log_start":"79'253609","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2797207852,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":253353,"num_read_kb":994517,"num_write":251482,"num_write_kb":1005841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"82'268542","reported_seq":537331,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:32.177113+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:26:32.177113+0000","last_peered":"2023-09-23T08:26:32.177113+0000","last_clean":"2023-09-23T08:26:32.177113+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:26:32.177113+0000","last_undegraded":"2023-09-23T08:26:32.177113+0000","last_fullsized":"2023-09-23T08:26:32.177113+0000","mapping_epoch":13,"log_start":"79'258507","ondisk_log_start":"79'258507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2993369370,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":269439,"num_read_kb":1063723,"num_write":267754,"num_write_kb":1070929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"82'261675","reported_seq":522233,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:26:33.172794+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:26:33.172794+0000","last_peered":"2023-09-23T08:26:33.172794+0000","last_clean":"2023-09-23T08:26:33.172794+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:26:33.172794+0000","last_undegraded":"2023-09-23T08:26:33.172794+0000","last_fullsized":"2023-09-23T08:26:33.172794+0000","mapping_epoch":13,"log_start":"79'251607","ondisk_log_start":"79'251607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":676,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 235s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2886394174,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":260564,"num_read_kb":1023151,"num_write":258789,"num_write_kb":1035006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"82'270467","reported_seq":537456,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:34.679738+0000","last_change":"2023-09-23T08:26:31.357023+0000","last_active":"2023-09-23T08:26:34.679738+0000","last_peered":"2023-09-23T08:26:34.679738+0000","last_clean":"2023-09-23T08:26:34.679738+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:26:34.679738+0000","last_undegraded":"2023-09-23T08:26:34.679738+0000","last_fullsized":"2023-09-23T08:26:34.679738+0000","mapping_epoch":13,"log_start":"79'260411","ondisk_log_start":"79'260411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2972754390,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":266800,"num_read_kb":1046732,"num_write":264943,"num_write_kb":1059652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"82'247935","reported_seq":492762,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:26:34.639562+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:26:34.639562+0000","last_peered":"2023-09-23T08:26:34.639562+0000","last_clean":"2023-09-23T08:26:34.639562+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:26:34.639562+0000","last_undegraded":"2023-09-23T08:26:34.639562+0000","last_fullsized":"2023-09-23T08:26:34.639562+0000","mapping_epoch":13,"log_start":"79'237908","ondisk_log_start":"79'237908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":775,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 233s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2697421101,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":244378,"num_read_kb":958785,"num_write":241927,"num_write_kb":967621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"82'261407","reported_seq":514163,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:26:32.134782+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:26:32.134782+0000","last_peered":"2023-09-23T08:26:32.134782+0000","last_clean":"2023-09-23T08:26:32.134782+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:26:32.134782+0000","last_undegraded":"2023-09-23T08:26:32.134782+0000","last_fullsized":"2023-09-23T08:26:32.134782+0000","mapping_epoch":13,"log_start":"79'251405","ondisk_log_start":"79'251405","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":564,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 231s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2767634966,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":252478,"num_read_kb":990247,"num_write":248812,"num_write_kb":995131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":253,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:06.950625+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:26:06.950625+0000","last_peered":"2023-09-23T08:26:06.950625+0000","last_clean":"2023-09-23T08:26:06.950625+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:26:06.950625+0000","last_undegraded":"2023-09-23T08:26:06.950625+0000","last_fullsized":"2023-09-23T08:26:06.950625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22802873131,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2060952,"num_read_kb":8090711,"num_write":2040412,"num_write_kb":8160673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16700801024,"data_stored":20949255766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80407,"ondisk_log_size":80407,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739208,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4412892,"kb_used_data":3021076,"kb_used_omap":219,"kb_used_meta":1391588,"kb_avail":89958948,"statfs":{"total":96636764160,"available":92117962752,"internally_reserved":0,"allocated":3093581824,"data_stored":3871272111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1424986957},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,0,1,3,1,4,14],"upper_bound":256},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":0.92700000000000005,"15min":0.72999999999999998},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":10.922000000000001,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":1.181,"5min":0.92600000000000005,"15min":1.0609999999999999},"min":{"1min":0.23000000000000001,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":10.954000000000001,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.32600000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0569999999999999,"15min":0.90100000000000002},"min":{"1min":0.222,"5min":0.219,"15min":0.215},"max":{"1min":5.931,"5min":11.65,"15min":25.550000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.135,"5min":1.609,"15min":1.097},"min":{"1min":0.223,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":5.867,"5min":13.914,"15min":13.914},"last":0.22}]}]},{"osd":1,"up_from":8,"seq":34359739197,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10096912,"kb_used_data":8153096,"kb_used_omap":605,"kb_used_meta":1943202,"kb_avail":84274928,"statfs":{"total":96636764160,"available":86297526272,"internally_reserved":0,"allocated":8348770304,"data_stored":10473166049,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":1989839220},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,9,14,20,5,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.83699999999999997,"15min":0.71099999999999997},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.6929999999999996,"5min":10.25,"15min":10.25},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.9399999999999999,"15min":1.137},"min":{"1min":0.192,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.6980000000000004,"5min":15.291,"15min":15.291},"last":0.43099999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:25:50 2023","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":1.1200000000000001,"15min":0.90500000000000003},"min":{"1min":0.215,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":26.117000000000001,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.0800000000000001,"15min":0.85599999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":26.151,"5min":26.151,"15min":26.151},"last":0.41299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739204,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7075076,"kb_used_data":5135612,"kb_used_omap":378,"kb_used_meta":1939077,"kb_avail":87296764,"statfs":{"total":96636764160,"available":89391886336,"internally_reserved":0,"allocated":5258866688,"data_stored":6605119432,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":1985614973},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,0,8,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.95599999999999996,"15min":1.419},"min":{"1min":0.182,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.2770000000000001,"5min":8.7569999999999997,"15min":21.207000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.1459999999999999,"15min":0.88800000000000001},"min":{"1min":0.26700000000000002,"5min":0.22500000000000001,"15min":0.20300000000000001},"max":{"1min":2.3140000000000001,"5min":20.436,"15min":20.436},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81599999999999995,"15min":0.747},"min":{"1min":0.221,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":6.351,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.23899999999999999,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":6.2809999999999997,"5min":20.491,"15min":21.757999999999999},"last":0.37}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5258403840,"data_stored":6604527122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8349298688,"data_stored":10473540395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3093098496,"data_stored":3871188249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:26:36.834 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:36.835 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:36.835 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:36.835 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:36.835 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:36.835 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:36.836 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:36.836 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:36.836 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:26:37.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:26:37.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:37.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:37.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:37.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:37.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:37.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:37.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:37.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:37.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:37.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:37.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:37.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:39.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:39.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:39.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:39.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:39.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:39.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:39.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:39.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:39.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:39.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:39.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:39.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:40.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:40.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:40.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:40.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:40.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:40.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:40.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:40.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:40.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:40.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:40.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:40.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:40.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:40.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:40.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:40.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:41.214 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:41.209+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:26:41.221 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:41.217+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:26:41.221 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:41.217+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:26:42.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:42.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:42.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:42.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:42.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:42.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:42.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:42.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:42.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:42.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:46.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:46.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:46.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:46.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:46.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:46.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:46.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:46.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:46.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:46.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:46.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:46.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:46.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:46.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:46.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:46.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:46.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:46.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:46.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:46.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:46.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:46.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:46.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:46.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:46.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:46.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:46.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:46.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:47.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:47.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:47.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:47.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:47.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:47.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:47.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:47.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:47.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:47.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:47.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:47.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:47.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:47.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:47.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:47.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:47.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:47.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:48.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:48.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:48.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:48.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:48.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:48.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:48.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:48.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:48.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:48.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:48.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:48.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:48.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:48.507 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:48.505+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:26:48.507 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:48.505+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:26:48.507 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:48.505+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:26:48.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:48.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:48.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:48.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:48.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:48.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:48.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:48.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:48.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:48.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:48.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:48.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:48.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:48.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:49.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:49.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:49.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:49.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:49.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:49.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:49.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:49.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:49.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:49.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:49.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:49.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:49.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:50.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:50.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:50.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:50.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:50.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:50.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:50.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:50.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:50.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:50.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:50.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:50.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:50.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:50.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:50.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:50.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:50.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:50.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:54.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:54.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:54.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:54.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:54.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:54.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:54.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:54.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:54.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:54.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:54.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:54.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:54.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:54.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:55.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:55.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:55.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:55.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:55.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:55.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:55.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:55.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:55.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:55.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:55.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:55.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:26:55.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:55.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:26:55.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:55.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:26:55.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:55.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:26:55.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:55.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:26:55.189 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:55.185+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:26:55.189 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:55.185+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:26:55.878 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:55.873+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:26:55.879 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:26:55.873+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:26:56.837 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:26:57.827 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:26:57.828 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:26:57.870 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2187,"stamp":"2023-09-23T08:26:56.311208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22830132555,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2069622,"num_read_kb":8124990,"num_write":2049085,"num_write_kb":8196711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80495,"ondisk_log_size":80495,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21924764,"kb_used_data":16367872,"kb_used_omap":1203,"kb_used_meta":5555660,"kb_avail":261190756,"statfs":{"total":289910292480,"available":267459334144,"internally_reserved":0,"allocated":16760700928,"data_stored":21007499608,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1232578,"internal_metadata":5688996158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,9,5,9,15,5,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14303232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4718,"num_read_kb":18828,"num_write":4709,"num_write_kb":18836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007278"},"pg_stats":[{"pgid":"2.7","version":"82'253718","reported_seq":499031,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:52.768825+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:26:52.768825+0000","last_peered":"2023-09-23T08:26:52.768825+0000","last_clean":"2023-09-23T08:26:52.768825+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:26:52.768825+0000","last_undegraded":"2023-09-23T08:26:52.768825+0000","last_fullsized":"2023-09-23T08:26:52.768825+0000","mapping_epoch":13,"log_start":"79'243710","ondisk_log_start":"79'243710","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2691449167,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":245024,"num_read_kb":961978,"num_write":241451,"num_write_kb":965708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"82'279735","reported_seq":550347,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:52.750955+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:26:52.750955+0000","last_peered":"2023-09-23T08:26:52.750955+0000","last_clean":"2023-09-23T08:26:52.750955+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:26:52.750955+0000","last_undegraded":"2023-09-23T08:26:52.750955+0000","last_fullsized":"2023-09-23T08:26:52.750955+0000","mapping_epoch":13,"log_start":"80'269707","ondisk_log_start":"80'269707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3003793727,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":271093,"num_read_kb":1060270,"num_write":267503,"num_write_kb":1069781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"82'264698","reported_seq":519359,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:52.747642+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:26:52.747642+0000","last_peered":"2023-09-23T08:26:52.747642+0000","last_clean":"2023-09-23T08:26:52.747642+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:26:52.747642+0000","last_undegraded":"2023-09-23T08:26:52.747642+0000","last_fullsized":"2023-09-23T08:26:52.747642+0000","mapping_epoch":13,"log_start":"79'254609","ondisk_log_start":"79'254609","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2800107820,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":254358,"num_read_kb":998537,"num_write":252450,"num_write_kb":1009713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"82'269512","reported_seq":539256,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:52.747531+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:26:52.747531+0000","last_peered":"2023-09-23T08:26:52.747531+0000","last_clean":"2023-09-23T08:26:52.747531+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:26:52.747531+0000","last_undegraded":"2023-09-23T08:26:52.747531+0000","last_fullsized":"2023-09-23T08:26:52.747531+0000","mapping_epoch":13,"log_start":"80'259507","ondisk_log_start":"80'259507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2996257050,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":270390,"num_read_kb":1067515,"num_write":268724,"num_write_kb":1074809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"82'262791","reported_seq":524415,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:26:53.462678+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:26:53.462678+0000","last_peered":"2023-09-23T08:26:53.462678+0000","last_clean":"2023-09-23T08:26:53.462678+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:26:53.462678+0000","last_undegraded":"2023-09-23T08:26:53.462678+0000","last_fullsized":"2023-09-23T08:26:53.462678+0000","mapping_epoch":13,"log_start":"80'252707","ondisk_log_start":"80'252707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":767,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 256s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2889568574,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":261617,"num_read_kb":1027351,"num_write":259822,"num_write_kb":1039138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"82'271694","reported_seq":539938,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:54.886293+0000","last_change":"2023-09-23T08:26:50.736776+0000","last_active":"2023-09-23T08:26:54.886293+0000","last_peered":"2023-09-23T08:26:54.886293+0000","last_clean":"2023-09-23T08:26:54.886293+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:26:54.886293+0000","last_undegraded":"2023-09-23T08:26:54.886293+0000","last_fullsized":"2023-09-23T08:26:54.886293+0000","mapping_epoch":13,"log_start":"80'261611","ondisk_log_start":"80'261611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2976772566,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":268041,"num_read_kb":1051680,"num_write":266152,"num_write_kb":1064488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"82'248919","reported_seq":494672,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:26:54.889008+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:26:54.889008+0000","last_peered":"2023-09-23T08:26:54.889008+0000","last_clean":"2023-09-23T08:26:54.889008+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:26:54.889008+0000","last_undegraded":"2023-09-23T08:26:54.889008+0000","last_fullsized":"2023-09-23T08:26:54.889008+0000","mapping_epoch":13,"log_start":"80'238908","ondisk_log_start":"80'238908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":849,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 254s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2700157229,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":245279,"num_read_kb":962381,"num_write":242834,"num_write_kb":971249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"82'262693","reported_seq":516702,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:26:52.712134+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:26:52.712134+0000","last_peered":"2023-09-23T08:26:52.712134+0000","last_clean":"2023-09-23T08:26:52.712134+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:26:52.712134+0000","last_undegraded":"2023-09-23T08:26:52.712134+0000","last_fullsized":"2023-09-23T08:26:52.712134+0000","mapping_epoch":13,"log_start":"80'252605","ondisk_log_start":"80'252605","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":593,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 251s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2771436054,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":253714,"num_read_kb":995187,"num_write":250012,"num_write_kb":999931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":253,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:06.950625+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:26:06.950625+0000","last_peered":"2023-09-23T08:26:06.950625+0000","last_clean":"2023-09-23T08:26:06.950625+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:26:06.950625+0000","last_undegraded":"2023-09-23T08:26:06.950625+0000","last_fullsized":"2023-09-23T08:26:06.950625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22829542187,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2069516,"num_read_kb":8124899,"num_write":2048948,"num_write_kb":8194817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16759373824,"data_stored":21006280278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80396,"ondisk_log_size":80396,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739212,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4494552,"kb_used_data":3031952,"kb_used_omap":219,"kb_used_meta":1462372,"kb_avail":89877288,"statfs":{"total":96636764160,"available":92034342912,"internally_reserved":0,"allocated":3104718848,"data_stored":3882134703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1497469773},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,0,2,9,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":0.92700000000000005,"15min":0.72999999999999998},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":10.922000000000001,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.24099999999999999},{"interface":"front","average":{"1min":1.181,"5min":0.92600000000000005,"15min":1.0609999999999999},"min":{"1min":0.23000000000000001,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":10.954000000000001,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.28199999999999997}]},{"osd":1,"last update":"Sat Sep 23 08:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0569999999999999,"15min":0.90100000000000002},"min":{"1min":0.222,"5min":0.219,"15min":0.215},"max":{"1min":5.931,"5min":11.65,"15min":25.550000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.135,"5min":1.609,"15min":1.097},"min":{"1min":0.223,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":5.867,"5min":13.914,"15min":13.914},"last":0.25900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739201,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10261304,"kb_used_data":8182828,"kb_used_omap":605,"kb_used_meta":2077858,"kb_avail":84110536,"statfs":{"total":96636764160,"available":86129188864,"internally_reserved":0,"allocated":8379215872,"data_stored":10502849761,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":620172,"internal_metadata":2127726964},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,5,3,5,6,3,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.83699999999999997,"15min":0.71099999999999997},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.6929999999999996,"5min":10.25,"15min":10.25},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.9399999999999999,"15min":1.137},"min":{"1min":0.192,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.6980000000000004,"5min":15.291,"15min":15.291},"last":2.875}]},{"osd":2,"last update":"Sat Sep 23 08:25:50 2023","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":1.1200000000000001,"15min":0.90500000000000003},"min":{"1min":0.215,"5min":0.21199999999999999,"15min":0.19700000000000001},"max":{"1min":26.117000000000001,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.0800000000000001,"15min":0.85599999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":26.151,"5min":26.151,"15min":26.151},"last":0.44600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739208,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7168908,"kb_used_data":5153092,"kb_used_omap":378,"kb_used_meta":2015429,"kb_avail":87202932,"statfs":{"total":96636764160,"available":89295802368,"internally_reserved":0,"allocated":5276766208,"data_stored":6622515144,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":2063799421},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,2,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.78100000000000003,"15min":1.3220000000000001},"min":{"1min":0.25700000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":2.8660000000000001,"5min":6.7220000000000004,"15min":21.207000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":1.0800000000000001,"15min":0.871},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.20300000000000001},"max":{"1min":4.3769999999999998,"5min":20.436,"15min":20.436},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73199999999999998,"15min":0.75900000000000001},"min":{"1min":0.21099999999999999,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":4.3399999999999999,"5min":9.0150000000000006,"15min":15.039999999999999},"last":0.307},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.72199999999999998,"15min":0.751},"min":{"1min":0.23300000000000001,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":0.78000000000000003,"5min":20.491,"15min":21.757999999999999},"last":0.29199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5276037120,"data_stored":6621656594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8378847232,"data_stored":10502335275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3104489472,"data_stored":3882288409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:26:57.872 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:57.872 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:57.872 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:57.873 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:57.873 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:57.873 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:57.874 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:57.874 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:26:57.874 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:26:59.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:59.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:26:59.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:59.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:26:59.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:59.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:26:59.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:59.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:26:59.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:59.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:26:59.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:59.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:26:59.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:26:59.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:00.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:00.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:00.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:00.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:00.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:00.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:00.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:00.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:00.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:00.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:00.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:00.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:00.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:00.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:27:00.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:00.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:27:00.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:00.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:00.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:00.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:00.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:00.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:00.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:00.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:00.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:00.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:01.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:01.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:01.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:01.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:01.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:01.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:01.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:01.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:01.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:01.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:01.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:01.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:01.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:01.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:01.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:01.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:03.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:03.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:03.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:03.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:03.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:03.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:03.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:03.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:03.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:03.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:03.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:03.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:03.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:03.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:03.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:03.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:03.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:03.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:04.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:04.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:04.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:04.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:04.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:04.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:04.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:04.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:04.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:04.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:04.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:04.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:04.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:04.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:04.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:04.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:04.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:04.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:04.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:04.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:05.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:05.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:05.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:05.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:05.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:05.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:05.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:05.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:05.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:05.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:06.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:06.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:06.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:06.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:06.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:06.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:06.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:06.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:06.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:06.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:06.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:06.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:06.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:06.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:06.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:06.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:06.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:06.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:07.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:07.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:07.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:07.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:27:07.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:07.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:07.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:07.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:07.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:07.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:07.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:07.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:07.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:07.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:07.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:07.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:07.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:07.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:07.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:07.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:08.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:27:08.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:08.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:27:08.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:08.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:08.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:08.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:08.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:08.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:08.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:08.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:08.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:08.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:09.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:09.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:09.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:09.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:09.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:09.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:09.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:09.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:09.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:09.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:09.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:09.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:09.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:09.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:09.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:09.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:09.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:09.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:11.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:11.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:11.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:11.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:11.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:11.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:11.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:11.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:11.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:11.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:11.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:11.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:11.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:11.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:11.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:11.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:11.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:11.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:11.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:12.222 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:12.216+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:27:12.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:12.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:27:12.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:12.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:12.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:12.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:12.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:12.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:12.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:12.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:12.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:12.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:13.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:13.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:13.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:13.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:13.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:13.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:13.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:13.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:13.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:13.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:13.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:13.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:13.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:13.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:14.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:14.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:14.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:14.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:14.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:14.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:14.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:14.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:14.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:14.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:14.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:14.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:14.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:14.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:14.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:14.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:14.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:14.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:14.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:14.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:16.514 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:16.508+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:27:16.514 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:16.508+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:27:16.514 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:16.508+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:27:16.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:16.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:16.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:16.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:16.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:16.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:16.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:16.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:16.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:16.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:16.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:16.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:16.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:16.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:16.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:16.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:16.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:16.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:17.875 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:27:18.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:18.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:18.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:18.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:18.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:18.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:18.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:18.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:18.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:18.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:18.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:18.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:18.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:27:18.718 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:27:18.751 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2199,"stamp":"2023-09-23T08:27:18.318222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22852767051,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2077782,"num_read_kb":8157582,"num_write":2057480,"num_write_kb":8230291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80533,"ondisk_log_size":80533,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21674680,"kb_used_data":16415648,"kb_used_omap":1273,"kb_used_meta":5257734,"kb_avail":261440840,"statfs":{"total":289910292480,"available":267715420160,"internally_reserved":0,"allocated":16809623552,"data_stored":21053116760,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1303871,"internal_metadata":5383920321},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,5,4,10,14,15,12,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7753728,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2859,"num_read_kb":11428,"num_write":2947,"num_write_kb":11788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002300"},"pg_stats":[{"pgid":"2.7","version":"82'254757","reported_seq":501001,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:27:13.354582+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:27:13.354582+0000","last_peered":"2023-09-23T08:27:13.354582+0000","last_clean":"2023-09-23T08:27:13.354582+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:27:13.354582+0000","last_undegraded":"2023-09-23T08:27:13.354582+0000","last_fullsized":"2023-09-23T08:27:13.354582+0000","mapping_epoch":13,"log_start":"80'244710","ondisk_log_start":"80'244710","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2694046031,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":245945,"num_read_kb":965650,"num_write":242439,"num_write_kb":969660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"82'280932","reported_seq":552683,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:27:13.325453+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:27:13.325453+0000","last_peered":"2023-09-23T08:27:13.325453+0000","last_clean":"2023-09-23T08:27:13.325453+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:27:13.325453+0000","last_undegraded":"2023-09-23T08:27:13.325453+0000","last_fullsized":"2023-09-23T08:27:13.325453+0000","mapping_epoch":13,"log_start":"80'270907","ondisk_log_start":"80'270907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3007226175,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":272219,"num_read_kb":1064762,"num_write":268649,"num_write_kb":1074365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"82'265801","reported_seq":521441,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:27:13.309319+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:27:13.309319+0000","last_peered":"2023-09-23T08:27:13.309319+0000","last_clean":"2023-09-23T08:27:13.309319+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:27:13.309319+0000","last_undegraded":"2023-09-23T08:27:13.309319+0000","last_fullsized":"2023-09-23T08:27:13.309319+0000","mapping_epoch":13,"log_start":"80'255709","ondisk_log_start":"80'255709","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2802860332,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":255323,"num_read_kb":1002397,"num_write":253502,"num_write_kb":1013921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"82'270459","reported_seq":541189,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:27:13.324552+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:27:13.324552+0000","last_peered":"2023-09-23T08:27:13.324552+0000","last_clean":"2023-09-23T08:27:13.324552+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:27:13.324552+0000","last_undegraded":"2023-09-23T08:27:13.324552+0000","last_fullsized":"2023-09-23T08:27:13.324552+0000","mapping_epoch":13,"log_start":"80'260407","ondisk_log_start":"80'260407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":2998628634,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":271375,"num_read_kb":1071455,"num_write":269671,"num_write_kb":1078597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"82'263953","reported_seq":526749,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:27:13.740559+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:27:13.740559+0000","last_peered":"2023-09-23T08:27:13.740559+0000","last_clean":"2023-09-23T08:27:13.740559+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:27:13.740559+0000","last_undegraded":"2023-09-23T08:27:13.740559+0000","last_fullsized":"2023-09-23T08:27:13.740559+0000","mapping_epoch":13,"log_start":"80'253907","ondisk_log_start":"80'253907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":810,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 276s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2892656958,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":262772,"num_read_kb":1031971,"num_write":260944,"num_write_kb":1043626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"82'272765","reported_seq":542012,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:27:15.168908+0000","last_change":"2023-09-23T08:27:07.288241+0000","last_active":"2023-09-23T08:27:15.168908+0000","last_peered":"2023-09-23T08:27:15.168908+0000","last_clean":"2023-09-23T08:27:15.168908+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:27:15.168908+0000","last_undegraded":"2023-09-23T08:27:15.168908+0000","last_fullsized":"2023-09-23T08:27:15.168908+0000","mapping_epoch":13,"log_start":"80'262711","ondisk_log_start":"80'262711","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2979652054,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":269024,"num_read_kb":1055596,"num_write":267214,"num_write_kb":1068736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"82'249995","reported_seq":496742,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:27:15.142617+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:27:15.142617+0000","last_peered":"2023-09-23T08:27:15.142617+0000","last_clean":"2023-09-23T08:27:15.142617+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:27:15.142617+0000","last_undegraded":"2023-09-23T08:27:15.142617+0000","last_fullsized":"2023-09-23T08:27:15.142617+0000","mapping_epoch":13,"log_start":"80'239908","ondisk_log_start":"80'239908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":895,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 274s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2702909741,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":246255,"num_read_kb":966277,"num_write":243870,"num_write_kb":975393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"82'263836","reported_seq":518907,"reported_epoch":82,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:27:13.301698+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:27:13.301698+0000","last_peered":"2023-09-23T08:27:13.301698+0000","last_clean":"2023-09-23T08:27:13.301698+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:27:13.301698+0000","last_undegraded":"2023-09-23T08:27:13.301698+0000","last_fullsized":"2023-09-23T08:27:13.301698+0000","mapping_epoch":13,"log_start":"80'253805","ondisk_log_start":"80'253805","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":658,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 272s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2774196758,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":254763,"num_read_kb":999383,"num_write":251054,"num_write_kb":1004099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":253,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:06.950625+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:26:06.950625+0000","last_peered":"2023-09-23T08:26:06.950625+0000","last_clean":"2023-09-23T08:26:06.950625+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:26:06.950625+0000","last_undegraded":"2023-09-23T08:26:06.950625+0000","last_fullsized":"2023-09-23T08:26:06.950625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22852176683,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2077676,"num_read_kb":8157491,"num_write":2057343,"num_write_kb":8228397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16810098688,"data_stored":21053552214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80434,"ondisk_log_size":80434,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739216,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4540284,"kb_used_data":3041140,"kb_used_omap":219,"kb_used_meta":1498916,"kb_avail":89831556,"statfs":{"total":96636764160,"available":91987513344,"internally_reserved":0,"allocated":3114127360,"data_stored":3890850991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1534890829},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,3,3,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.81200000000000006,"15min":0.72699999999999998},"min":{"1min":0.20499999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.52200000000000002,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.82799999999999996,"15min":1.0429999999999999},"min":{"1min":0.23200000000000001,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":0.46700000000000003,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.31}]},{"osd":1,"last update":"Sat Sep 23 08:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.95099999999999996,"15min":0.93200000000000005},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.2489999999999997,"5min":7.9859999999999998,"15min":25.550000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":1.026,"5min":1.6459999999999999,"15min":1.127},"min":{"1min":0.218,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":6.0869999999999997,"5min":13.914,"15min":13.914},"last":0.43099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739205,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9872636,"kb_used_data":8206964,"kb_used_omap":675,"kb_used_meta":1664988,"kb_avail":84499204,"statfs":{"total":96636764160,"available":86527184896,"internally_reserved":0,"allocated":8403931136,"data_stored":10525918433,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":691465,"internal_metadata":1704948471},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,4,2,4,6,9,8,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.22800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":5.6520000000000001,"5min":7.5789999999999997,"15min":10.25},"last":0.373},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.925,"15min":1.1819999999999999},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.5229999999999997,"5min":15.291,"15min":15.291},"last":0.28499999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":1.026,"15min":0.91400000000000003},"min":{"1min":0.23499999999999999,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":4.4980000000000002,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.307},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88800000000000001,"15min":0.88900000000000001},"min":{"1min":0.312,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":4.6100000000000003,"5min":26.151,"15min":26.151},"last":0.34100000000000003}]}]},{"osd":0,"up_from":8,"seq":34359739212,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7261760,"kb_used_data":5167544,"kb_used_omap":378,"kb_used_meta":2093829,"kb_avail":87110080,"statfs":{"total":96636764160,"available":89200721920,"internally_reserved":0,"allocated":5291565056,"data_stored":6636347336,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":2144081021},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,3,5,5,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.78100000000000003,"15min":1.3220000000000001},"min":{"1min":0.25700000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":2.8660000000000001,"5min":6.7220000000000004,"15min":21.207000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":1.0800000000000001,"15min":0.871},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.20300000000000001},"max":{"1min":4.3769999999999998,"5min":20.436,"15min":20.436},"last":0.39100000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73199999999999998,"15min":0.75900000000000001},"min":{"1min":0.21099999999999999,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":4.3399999999999999,"5min":9.0150000000000006,"15min":15.039999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.72199999999999998,"15min":0.751},"min":{"1min":0.23300000000000001,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":0.78000000000000003,"5min":20.491,"15min":21.757999999999999},"last":0.309}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5291728896,"data_stored":6636324370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8404529152,"data_stored":10526284587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3113840640,"data_stored":3890943257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:27:18.753 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:18.753 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:18.753 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:18.753 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:18.753 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:18.754 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:18.754 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:18.754 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:18.754 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-09-23T08:27:18.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:18.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:18.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:18.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:18.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:18.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:18.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:19.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:19.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:19.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:19.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:19.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:19.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:19.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:19.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:19.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:19.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:19.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:19.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:19.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:19.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:19.583 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-09-23T08:27:19.639 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-09-23T08:27:20.562 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-09-23T08:27:20.609 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-09-23T08:27:21.470 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-09-23T08:27:21.516 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-09-23T08:27:21.956 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:21.952+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:27:21.978 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:21.972+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:27:22.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:22.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:22.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:22.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:22.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:22.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:22.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:22.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:22.256 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-09-23T08:27:22.300 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-09-23T08:27:22.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:22.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:22.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:22.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:22.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:22.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:22.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:22.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:23.289 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-09-23T08:27:23.351 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-09-23T08:27:23.904 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:27:23.900+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:27:23.917 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:27:23.900+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:27:24.309 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-09-23T08:27:24.389 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-09-23T08:27:24.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:24.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:24.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:24.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:24.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:24.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:24.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:24.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:24.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:24.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:24.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:24.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:24.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:24.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:24.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:24.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:24.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:24.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:25.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:25.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:25.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:25.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:25.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:25.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:25.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:25.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:25.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:25.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:25.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:25.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:25.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:25.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:25.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:25.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-09-23T08:27:25.509 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-09-23T08:27:26.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:26.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:26.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:26.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:26.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:26.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:26.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:26.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:26.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:26.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:26.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:26.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:26.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:26.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:26.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:26.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:26.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:26.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:26.602 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-09-23T08:27:26.660 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:27:27.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:27.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:27:27.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:27.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:27.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:27.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:27.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:27.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:27.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:27.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:27.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:27.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:27.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:27.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:27.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:27.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:27.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:27.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:27.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:27.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:29.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:29.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:29.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:29.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:29.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:29.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:29.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:29.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:29.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:29.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:29.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:29.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:29.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:29.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:29.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:29.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:30.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:30.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:27:30.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:30.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:30.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:30.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:30.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:30.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:30.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:30.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:30.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:30.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:30.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:30.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:30.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:30.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:30.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:30.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:30.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:30.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:33.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:33.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:33.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:33.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:33.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:33.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:33.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:33.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:33.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:33.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:33.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:33.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:33.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:33.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:33.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:33.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:33.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:33.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:33.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:33.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:33.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:33.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:33.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:33.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:33.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:34.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:34.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:34.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:34.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:34.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:34.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:34.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:34.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:27:34.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:34.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:34.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:34.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:34.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:34.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:34.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:34.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:34.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:34.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:35.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:35.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:35.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:35.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:35.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:35.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:35.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:35.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:35.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:35.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:35.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:35.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:35.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:35.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:35.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:35.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:36.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:36.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:36.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:36.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:36.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:36.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:36.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:36.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:36.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:36.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:27:36.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:36.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:36.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:36.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:36.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:36.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:36.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:36.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:36.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:36.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:37.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:37.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:37.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:37.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:37.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:37.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:37.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:37.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:37.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:37.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:37.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:37.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:37.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:37.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:37.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:37.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:38.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:38.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:38.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:38.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:38.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:38.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:38.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:38.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:38.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:38.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:38.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:38.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:38.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:38.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:38.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:38.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:40.076 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:40.072+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:27:40.076 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:40.072+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:27:40.077 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:40.072+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:27:40.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:40.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:40.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:40.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:40.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:40.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:40.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:40.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:40.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:40.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:41.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:41.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:42.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:42.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:42.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:42.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:42.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:42.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:42.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:42.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:42.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:42.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:42.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:42.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:42.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:42.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:44.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:44.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:44.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:44.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:44.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:44.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:44.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:44.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:44.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:44.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:44.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:44.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:44.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:44.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:44.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:44.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:45.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:44.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:45.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:45.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:45.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:45.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:45.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:45.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:45.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:45.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:45.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:45.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:45.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:45.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:45.720 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:45.716+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:27:45.721 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:45.716+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:27:45.721 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:45.716+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:27:46.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:46.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:46.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:46.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:46.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:46.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:46.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:46.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:46.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:46.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:46.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:46.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:46.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:46.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:46.661 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:27:47.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:46.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:47.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:47.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:47.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:47.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:47.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:47.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:47.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:47.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:47.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:47.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:47.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:47.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:47.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:47.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:47.354 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:47.348+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:27:47.354 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:47.348+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:27:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:27:47.566 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:27:47.637 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2213,"stamp":"2023-09-23T08:27:46.322866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22878289227,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2089696,"num_read_kb":8205218,"num_write":2069463,"num_write_kb":8278223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80510,"ondisk_log_size":80510,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21429676,"kb_used_data":16474676,"kb_used_omap":1273,"kb_used_meta":4953670,"kb_avail":261685844,"statfs":{"total":289910292480,"available":267966304256,"internally_reserved":0,"allocated":16870068224,"data_stored":21105031442,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1303871,"internal_metadata":5072558785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,2,5,9,18,12,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9555968,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4557,"num_read_kb":18224,"num_write":4622,"num_write_kb":18488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001926"},"pg_stats":[{"pgid":"2.7","version":"83'256267","reported_seq":503886,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:27:43.974544+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:27:43.974544+0000","last_peered":"2023-09-23T08:27:43.974544+0000","last_clean":"2023-09-23T08:27:43.974544+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:27:43.974544+0000","last_undegraded":"2023-09-23T08:27:43.974544+0000","last_fullsized":"2023-09-23T08:27:43.974544+0000","mapping_epoch":13,"log_start":"80'246210","ondisk_log_start":"80'246210","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2697118031,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":247296,"num_read_kb":971054,"num_write":243868,"num_write_kb":975376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"83'282552","reported_seq":555871,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:27:43.979188+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:27:43.979188+0000","last_peered":"2023-09-23T08:27:43.979188+0000","last_clean":"2023-09-23T08:27:43.979188+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:27:43.979188+0000","last_undegraded":"2023-09-23T08:27:43.979188+0000","last_fullsized":"2023-09-23T08:27:43.979188+0000","mapping_epoch":13,"log_start":"81'272507","ondisk_log_start":"81'272507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3010474303,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":273766,"num_read_kb":1070946,"num_write":270188,"num_write_kb":1080521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"83'267370","reported_seq":524498,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:27:43.968807+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:27:43.968807+0000","last_peered":"2023-09-23T08:27:43.968807+0000","last_clean":"2023-09-23T08:27:43.968807+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:27:43.968807+0000","last_undegraded":"2023-09-23T08:27:43.968807+0000","last_fullsized":"2023-09-23T08:27:43.968807+0000","mapping_epoch":13,"log_start":"80'257309","ondisk_log_start":"80'257309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2805879084,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":256791,"num_read_kb":1008269,"num_write":254990,"num_write_kb":1019873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"83'271998","reported_seq":544310,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:27:43.973756+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:27:43.973756+0000","last_peered":"2023-09-23T08:27:43.973756+0000","last_clean":"2023-09-23T08:27:43.973756+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:27:43.973756+0000","last_undegraded":"2023-09-23T08:27:43.973756+0000","last_fullsized":"2023-09-23T08:27:43.973756+0000","mapping_epoch":13,"log_start":"80'261907","ondisk_log_start":"80'261907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3001827610,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":272956,"num_read_kb":1077779,"num_write":271210,"num_write_kb":1084753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"83'265544","reported_seq":529859,"reported_epoch":83,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:27:44.011525+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:27:44.011525+0000","last_peered":"2023-09-23T08:27:44.011525+0000","last_clean":"2023-09-23T08:27:44.011525+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:27:44.011525+0000","last_undegraded":"2023-09-23T08:27:44.011525+0000","last_fullsized":"2023-09-23T08:27:44.011525+0000","mapping_epoch":13,"log_start":"80'255507","ondisk_log_start":"80'255507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":860,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 306s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2896052542,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":264266,"num_read_kb":1037943,"num_write":262482,"num_write_kb":1049778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"83'274347","reported_seq":545188,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:27:45.327202+0000","last_change":"2023-09-23T08:27:42.538948+0000","last_active":"2023-09-23T08:27:45.327202+0000","last_peered":"2023-09-23T08:27:45.327202+0000","last_clean":"2023-09-23T08:27:45.327202+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:27:45.327202+0000","last_undegraded":"2023-09-23T08:27:45.327202+0000","last_fullsized":"2023-09-23T08:27:45.327202+0000","mapping_epoch":13,"log_start":"80'264311","ondisk_log_start":"80'264311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2983027158,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":270592,"num_read_kb":1061856,"num_write":268772,"num_write_kb":1074968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"83'251475","reported_seq":499645,"reported_epoch":83,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:27:45.326705+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:27:45.326705+0000","last_peered":"2023-09-23T08:27:45.326705+0000","last_clean":"2023-09-23T08:27:45.326705+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:27:45.326705+0000","last_undegraded":"2023-09-23T08:27:45.326705+0000","last_fullsized":"2023-09-23T08:27:45.326705+0000","mapping_epoch":13,"log_start":"80'241408","ondisk_log_start":"80'241408","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":968,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 304s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2705895725,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":247651,"num_read_kb":971861,"num_write":245280,"num_write_kb":981033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"83'265422","reported_seq":522042,"reported_epoch":83,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:27:43.971553+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:27:43.971553+0000","last_peered":"2023-09-23T08:27:43.971553+0000","last_clean":"2023-09-23T08:27:43.971553+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:27:43.971553+0000","last_undegraded":"2023-09-23T08:27:43.971553+0000","last_fullsized":"2023-09-23T08:27:43.971553+0000","mapping_epoch":13,"log_start":"80'255405","ondisk_log_start":"80'255405","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":694,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 302s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2777424406,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":256272,"num_read_kb":1005419,"num_write":252536,"num_write_kb":1010027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":254,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:16.915243+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:26:16.915243+0000","last_peered":"2023-09-23T08:26:16.915243+0000","last_clean":"2023-09-23T08:26:16.915243+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:26:16.915243+0000","last_undegraded":"2023-09-23T08:26:16.915243+0000","last_fullsized":"2023-09-23T08:26:16.915243+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22877698859,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2089590,"num_read_kb":8205127,"num_write":2069326,"num_write_kb":8276329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16868864000,"data_stored":21103842902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80411,"ondisk_log_size":80411,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4646052,"kb_used_data":3051864,"kb_used_omap":219,"kb_used_meta":1593956,"kb_avail":89725788,"statfs":{"total":96636764160,"available":91879206912,"internally_reserved":0,"allocated":3125108736,"data_stored":3900254701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1632211789},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,1,1,0,5,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.81200000000000006,"15min":0.72699999999999998},"min":{"1min":0.20499999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.52200000000000002,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.82799999999999996,"15min":1.0429999999999999},"min":{"1min":0.23200000000000001,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":0.46700000000000003,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.95099999999999996,"15min":0.93200000000000005},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.2489999999999997,"5min":7.9859999999999998,"15min":25.550000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":1.026,"5min":1.6459999999999999,"15min":1.127},"min":{"1min":0.218,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":6.0869999999999997,"5min":13.914,"15min":13.914},"last":0.30299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739211,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10092080,"kb_used_data":8236624,"kb_used_omap":675,"kb_used_meta":1854748,"kb_avail":84279760,"statfs":{"total":96636764160,"available":86302474240,"internally_reserved":0,"allocated":8434302976,"data_stored":10552046111,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":691465,"internal_metadata":1899262711},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,2,5,15,5,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.22800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":5.6520000000000001,"5min":7.5789999999999997,"15min":10.25},"last":0.24199999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.925,"15min":1.1819999999999999},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.5229999999999997,"5min":15.291,"15min":15.291},"last":0.442}]},{"osd":2,"last update":"Sat Sep 23 08:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":1.026,"15min":0.91400000000000003},"min":{"1min":0.23499999999999999,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":4.4980000000000002,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88800000000000001,"15min":0.88900000000000001},"min":{"1min":0.312,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":4.6100000000000003,"5min":26.151,"15min":26.151},"last":0.41899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739218,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6691544,"kb_used_data":5186188,"kb_used_omap":378,"kb_used_meta":1504965,"kb_avail":87680296,"statfs":{"total":96636764160,"available":89784623104,"internally_reserved":0,"allocated":5310656512,"data_stored":6652730630,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":1541084285},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,3,3,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.78100000000000003,"15min":1.3220000000000001},"min":{"1min":0.25700000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":2.8660000000000001,"5min":6.7220000000000004,"15min":21.207000000000001},"last":0.248},{"interface":"front","average":{"1min":0.82599999999999996,"5min":1.0800000000000001,"15min":0.871},"min":{"1min":0.28999999999999998,"5min":0.249,"15min":0.20300000000000001},"max":{"1min":4.3769999999999998,"5min":20.436,"15min":20.436},"last":0.318}]},{"osd":2,"last update":"Sat Sep 23 08:27:37 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.17000000000000001},"max":{"1min":7.8490000000000002,"5min":9.0150000000000006,"15min":15.039999999999999},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.57099999999999995,"15min":0.76100000000000001},"min":{"1min":0.27200000000000002,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":4.7039999999999997,"5min":6.2809999999999997,"15min":21.757999999999999},"last":1.7390000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5309984768,"data_stored":6651917842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8434180096,"data_stored":10551704363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3124699136,"data_stored":3900220697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:27:47.639 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:47.639 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:47.639 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:47.640 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:47.640 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:47.640 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:47.640 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:47.640 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:27:47.640 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:27:48.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:48.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:48.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:48.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:48.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:48.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:48.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:48.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:48.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:48.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:48.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:48.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:48.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:48.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:49.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:49.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:49.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:49.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:49.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:49.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:49.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:49.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:49.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:49.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:49.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:49.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:49.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:49.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:49.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:49.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:50.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:50.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:50.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:50.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:50.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:50.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:50.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:50.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:50.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:50.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:50.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:50.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:50.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:50.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:51.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:51.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:51.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:51.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:51.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:51.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:51.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:51.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:51.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:51.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:51.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:51.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:51.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:51.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:51.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:51.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:51.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:51.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:52.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:52.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:52.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:52.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:53.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:53.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:53.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:53.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:53.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:53.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:53.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:53.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:53.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:53.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:53.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:53.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:53.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:53.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:53.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:53.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:54.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:54.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:54.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:54.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:54.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:54.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:54.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:54.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:54.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:54.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:55.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:54.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:55.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:55.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:55.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:55.612 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:55.608+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:27:55.612 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:55.608+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:27:55.620 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:55.616+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:27:55.620 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:55.616+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:27:55.620 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:55.616+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:27:55.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:55.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:55.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:55.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:55.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:55.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:55.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:55.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:55.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:55.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:57.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:57.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:57.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:57.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:57.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:57.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:57.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:57.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:57.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:57.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:57.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:57.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:57.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:57.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:57.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:57.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:58.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:58.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:58.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:58.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:58.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:58.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:58.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:58.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:58.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:58.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:58.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:58.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:58.587 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:58.584+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:27:58.587 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:58.584+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:27:58.588 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:27:58.584+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:27:58.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:58.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:58.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:58.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:58.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:58.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:58.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:27:58.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:58.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:58.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:58.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:58.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:58.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:59.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:59.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:58.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:59.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:27:59.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:27:59.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:27:59.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:27:59.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:27:59.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:27:59.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:27:59.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:27:59.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:27:59.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:27:59.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:27:59.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:27:59.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:00.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:00.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:00.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:00.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:00.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:00.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:00.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:00.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:00.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:00.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:00.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:00.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:00.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:00.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:00.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:00.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:00.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:00.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:00.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:00.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:01.955 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:01.952+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:01.956 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:01.952+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:02.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:02.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:02.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:02.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:02.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:02.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:02.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:02.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:02.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:02.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:02.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:02.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:02.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:02.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:02.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:02.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:02.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:02.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:03.478 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:03.472+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:03.479 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:03.472+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:04.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:04.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:04.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:04.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:04.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:04.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:04.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:04.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:04.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:04.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:04.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:04.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:04.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:04.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:04.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:04.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:04.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:04.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:05.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:05.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:05.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:05.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:05.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:05.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:05.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:05.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:05.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:05.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:05.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:05.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:05.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:05.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:05.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:05.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:05.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:05.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:05.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:05.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:05.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:05.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:05.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:05.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:05.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:05.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:05.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:05.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:05.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:05.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:07.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:07.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:07.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:07.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:07.642 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:28:07.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:07.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:07.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:07.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:07.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:07.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:07.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:07.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:07.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:07.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:07.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:07.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:08.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:08.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:08.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:08.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:08.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:08.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:08.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:08.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:08.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:08.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:08.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:08.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:08.487 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:08.483+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:28:08.487 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:08.483+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:08.488 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:08.483+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:08.547 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:28:08.554 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:28:08.625 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2224,"stamp":"2023-09-23T08:28:08.326450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22895336779,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2098066,"num_read_kb":8238670,"num_write":2077558,"num_write_kb":8310603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80520,"ondisk_log_size":80520,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21725408,"kb_used_data":16512256,"kb_used_omap":1273,"kb_used_meta":5211846,"kb_avail":261390112,"statfs":{"total":289910292480,"available":267663474688,"internally_reserved":0,"allocated":16908550144,"data_stored":21137881362,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1303871,"internal_metadata":5336931009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,5,1,5,4,15,24,10,6,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8650752,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4133,"num_read_kb":16516,"num_write":4097,"num_write_kb":16388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001957"},"pg_stats":[{"pgid":"2.7","version":"83'257248","reported_seq":505896,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:04.386559+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:28:04.386559+0000","last_peered":"2023-09-23T08:28:04.386559+0000","last_clean":"2023-09-23T08:28:04.386559+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:28:04.386559+0000","last_undegraded":"2023-09-23T08:28:04.386559+0000","last_fullsized":"2023-09-23T08:28:04.386559+0000","mapping_epoch":13,"log_start":"80'247210","ondisk_log_start":"80'247210","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2699059535,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":248313,"num_read_kb":975118,"num_write":244785,"num_write_kb":979044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"83'283675","reported_seq":558100,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:04.398522+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:28:04.398522+0000","last_peered":"2023-09-23T08:28:04.398522+0000","last_clean":"2023-09-23T08:28:04.398522+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:28:04.398522+0000","last_undegraded":"2023-09-23T08:28:04.398522+0000","last_fullsized":"2023-09-23T08:28:04.398522+0000","mapping_epoch":13,"log_start":"81'273607","ondisk_log_start":"81'273607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3012694335,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":274861,"num_read_kb":1075318,"num_write":271247,"num_write_kb":1084757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"83'268413","reported_seq":526600,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:04.382765+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:28:04.382765+0000","last_peered":"2023-09-23T08:28:04.382765+0000","last_clean":"2023-09-23T08:28:04.382765+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:28:04.382765+0000","last_undegraded":"2023-09-23T08:28:04.382765+0000","last_fullsized":"2023-09-23T08:28:04.382765+0000","mapping_epoch":13,"log_start":"80'258409","ondisk_log_start":"80'258409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2807849260,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":257839,"num_read_kb":1012461,"num_write":255970,"num_write_kb":1023793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"83'273082","reported_seq":546449,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:04.352808+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:28:04.352808+0000","last_peered":"2023-09-23T08:28:04.352808+0000","last_clean":"2023-09-23T08:28:04.352808+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:28:04.352808+0000","last_undegraded":"2023-09-23T08:28:04.352808+0000","last_fullsized":"2023-09-23T08:28:04.352808+0000","mapping_epoch":13,"log_start":"81'263007","ondisk_log_start":"81'263007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3004068122,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":274011,"num_read_kb":1081999,"num_write":272294,"num_write_kb":1089089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"83'266584","reported_seq":531942,"reported_epoch":83,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:28:04.105322+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:28:04.105322+0000","last_peered":"2023-09-23T08:28:04.105322+0000","last_clean":"2023-09-23T08:28:04.105322+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:28:04.105322+0000","last_undegraded":"2023-09-23T08:28:04.105322+0000","last_fullsized":"2023-09-23T08:28:04.105322+0000","mapping_epoch":13,"log_start":"81'256507","ondisk_log_start":"81'256507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":896,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 326s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2898252094,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":265291,"num_read_kb":1042043,"num_write":263493,"num_write_kb":1053822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"83'275462","reported_seq":547430,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:05.588079+0000","last_change":"2023-09-23T08:28:05.074747+0000","last_active":"2023-09-23T08:28:05.588079+0000","last_peered":"2023-09-23T08:28:05.588079+0000","last_clean":"2023-09-23T08:28:05.588079+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:28:05.588079+0000","last_undegraded":"2023-09-23T08:28:05.588079+0000","last_fullsized":"2023-09-23T08:28:05.588079+0000","mapping_epoch":13,"log_start":"81'265411","ondisk_log_start":"81'265411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2985394646,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":271703,"num_read_kb":1066292,"num_write":269857,"num_write_kb":1079308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"83'252477","reported_seq":501697,"reported_epoch":83,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:28:05.611033+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:28:05.611033+0000","last_peered":"2023-09-23T08:28:05.611033+0000","last_clean":"2023-09-23T08:28:05.611033+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:28:05.611033+0000","last_undegraded":"2023-09-23T08:28:05.611033+0000","last_fullsized":"2023-09-23T08:28:05.611033+0000","mapping_epoch":13,"log_start":"81'242408","ondisk_log_start":"81'242408","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1053,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 324s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2707878189,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":248673,"num_read_kb":975945,"num_write":246200,"num_write_kb":984713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"83'266544","reported_seq":524177,"reported_epoch":83,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:28:04.359368+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:28:04.359368+0000","last_peered":"2023-09-23T08:28:04.359368+0000","last_clean":"2023-09-23T08:28:04.359368+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:28:04.359368+0000","last_undegraded":"2023-09-23T08:28:04.359368+0000","last_fullsized":"2023-09-23T08:28:04.359368+0000","mapping_epoch":13,"log_start":"81'256505","ondisk_log_start":"81'256505","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":727,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 323s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2779550230,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":257269,"num_read_kb":1009403,"num_write":253575,"num_write_kb":1014183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":254,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-09-23T08:26:16.915243+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:26:16.915243+0000","last_peered":"2023-09-23T08:26:16.915243+0000","last_clean":"2023-09-23T08:26:16.915243+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:26:16.915243+0000","last_undegraded":"2023-09-23T08:26:16.915243+0000","last_fullsized":"2023-09-23T08:26:16.915243+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22894746411,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2097960,"num_read_kb":8238579,"num_write":2077421,"num_write_kb":8308709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16907780096,"data_stored":21137036886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80421,"ondisk_log_size":80421,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739226,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4721292,"kb_used_data":3059140,"kb_used_omap":219,"kb_used_meta":1661924,"kb_avail":89650548,"statfs":{"total":96636764160,"available":91802161152,"internally_reserved":0,"allocated":3132559360,"data_stored":3906570733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1701811021},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,0,6,4,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.81200000000000006,"15min":0.72699999999999998},"min":{"1min":0.20499999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.52200000000000002,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.82799999999999996,"15min":1.0429999999999999},"min":{"1min":0.23200000000000001,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":0.46700000000000003,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.26200000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.95099999999999996,"15min":0.93200000000000005},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.2489999999999997,"5min":7.9859999999999998,"15min":25.550000000000001},"last":1.159},{"interface":"front","average":{"1min":1.026,"5min":1.6459999999999999,"15min":1.127},"min":{"1min":0.218,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":6.0869999999999997,"5min":13.914,"15min":13.914},"last":0.42699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739215,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10224632,"kb_used_data":8255336,"kb_used_omap":675,"kb_used_meta":1968604,"kb_avail":84147208,"statfs":{"total":96636764160,"available":86166740992,"internally_reserved":0,"allocated":8453464064,"data_stored":10568409631,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":691465,"internal_metadata":2015851255},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,5,0,1,3,6,9,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.73199999999999998,"15min":0.75800000000000001},"min":{"1min":0.21099999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":9.0440000000000005,"5min":9.0440000000000005,"15min":10.25},"last":9.1560000000000006},{"interface":"front","average":{"1min":1.871,"5min":1.776,"15min":1.2749999999999999},"min":{"1min":0.217,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":8.9749999999999996,"5min":14.914,"15min":15.291},"last":0.49199999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:27:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.107,"15min":0.96499999999999997},"min":{"1min":0.23599999999999999,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":9.0079999999999991,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.92500000000000004,"15min":0.90500000000000003},"min":{"1min":0.23499999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":7.0830000000000002,"5min":26.151,"15min":26.151},"last":0.502}]}]},{"osd":0,"up_from":8,"seq":34359739222,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6779484,"kb_used_data":5197780,"kb_used_omap":378,"kb_used_meta":1581317,"kb_avail":87592356,"statfs":{"total":96636764160,"available":89694572544,"internally_reserved":0,"allocated":5322526720,"data_stored":6662900998,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":1619268733},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,3,11,5,6,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.73099999999999998,"15min":1.298},"min":{"1min":0.23000000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":3.0990000000000002,"5min":6.2409999999999997,"15min":21.207000000000001},"last":3.2909999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.878,"15min":0.88300000000000001},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.20300000000000001},"max":{"1min":4.0030000000000001,"5min":6.3090000000000002,"15min":20.436},"last":3.323}]},{"osd":2,"last update":"Sat Sep 23 08:27:37 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.17000000000000001},"max":{"1min":7.8490000000000002,"5min":9.0150000000000006,"15min":15.039999999999999},"last":0.193},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.57099999999999995,"15min":0.76100000000000001},"min":{"1min":0.27200000000000002,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":4.7039999999999997,"5min":6.2809999999999997,"15min":21.757999999999999},"last":3.3530000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5321891840,"data_stored":6662129170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8453771264,"data_stored":10568420139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3132116992,"data_stored":3906487577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:28:08.626 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:08.626 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:08.627 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:08.627 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:08.627 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:08.627 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:08.627 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:08.628 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:08.628 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:28:08.765 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:08.759+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:08.765 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:08.759+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:10.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:28:10.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:10.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:10.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:10.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:10.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:10.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:10.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:10.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:10.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:10.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:10.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:10.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:10.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:10.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:10.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:10.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:10.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:10.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:10.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:10.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:10.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:10.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:12.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:12.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:12.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:12.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:12.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:12.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:12.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:12.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:12.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:12.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:12.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:12.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:12.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:12.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:12.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:12.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:12.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:12.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:13.018 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:13.011+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:13.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:13.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:13.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:13.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:13.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:13.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:13.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:13.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:13.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:13.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:13.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:13.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:28:13.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:13.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:13.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:13.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:13.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:13.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:13.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:13.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:13.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:13.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:13.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:13.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:18.348 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:18.343+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:18.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:18.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:18.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:18.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:18.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:18.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:18.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:18.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:18.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:18.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:18.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:18.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:18.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:18.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:18.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:18.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:18.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:18.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:19.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:19.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:19.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:19.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:19.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:19.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:19.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:19.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:28:19.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:19.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:19.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:19.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:19.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:19.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:19.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:19.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:19.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:20.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:20.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:20.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:20.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:20.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:20.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:20.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:20.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:20.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:20.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:20.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:20.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:21.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:21.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:21.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:21.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:21.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:21.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:21.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:21.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:21.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:21.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:21.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:21.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:23.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:23.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:23.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:23.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:23.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:23.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:23.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:23.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:23.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:23.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:23.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:23.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:23.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:24.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:24.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:24.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:23.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:24.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:24.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:24.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:24.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:24.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:24.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:24.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:24.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:24.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:24.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:24.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:24.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:24.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:24.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:24.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:24.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:24.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:24.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:24.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:24.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:24.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:24.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:24.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:24.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:25.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:25.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:25.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:25.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:25.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:25.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:25.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:25.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:25.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:25.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:25.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:25.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:25.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:25.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:25.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:25.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:26.896 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:26.891+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:26.896 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:26.891+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:28.629 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:28:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:28:29.484 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:28:29.542 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2234,"stamp":"2023-09-23T08:28:28.333275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22912490827,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2106206,"num_read_kb":8271186,"num_write":2085740,"num_write_kb":8343331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80381,"ondisk_log_size":80381,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21173012,"kb_used_data":16550960,"kb_used_omap":1274,"kb_used_meta":4620741,"kb_avail":261942508,"statfs":{"total":289910292480,"available":268229128192,"internally_reserved":0,"allocated":16948183040,"data_stored":21171800338,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1305550,"internal_metadata":4731638834},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,3,5,4,14,2,7,7,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8536064,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3995,"num_read_kb":15952,"num_write":4030,"num_write_kb":16120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005576"},"pg_stats":[{"pgid":"2.7","version":"83'258277","reported_seq":507908,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:25.215006+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:28:25.215006+0000","last_peered":"2023-09-23T08:28:25.215006+0000","last_clean":"2023-09-23T08:28:25.215006+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:28:25.215006+0000","last_undegraded":"2023-09-23T08:28:25.215006+0000","last_fullsized":"2023-09-23T08:28:25.215006+0000","mapping_epoch":13,"log_start":"81'248210","ondisk_log_start":"81'248210","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2701164879,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":249284,"num_read_kb":979002,"num_write":245754,"num_write_kb":982920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"83'284820","reported_seq":560334,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:25.180757+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:28:25.180757+0000","last_peered":"2023-09-23T08:28:25.180757+0000","last_clean":"2023-09-23T08:28:25.180757+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:28:25.180757+0000","last_undegraded":"2023-09-23T08:28:25.180757+0000","last_fullsized":"2023-09-23T08:28:25.180757+0000","mapping_epoch":13,"log_start":"81'274807","ondisk_log_start":"81'274807","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3015102783,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":275939,"num_read_kb":1079626,"num_write":272332,"num_write_kb":1089097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"83'269509","reported_seq":528724,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:25.136369+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:28:25.136369+0000","last_peered":"2023-09-23T08:28:25.136369+0000","last_clean":"2023-09-23T08:28:25.136369+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:28:25.136369+0000","last_undegraded":"2023-09-23T08:28:25.136369+0000","last_fullsized":"2023-09-23T08:28:25.136369+0000","mapping_epoch":13,"log_start":"81'259409","ondisk_log_start":"81'259409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2810097964,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":258854,"num_read_kb":1016517,"num_write":257006,"num_write_kb":1027937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"83'274215","reported_seq":548645,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:25.171339+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:28:25.171339+0000","last_peered":"2023-09-23T08:28:25.171339+0000","last_clean":"2023-09-23T08:28:25.171339+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:28:25.171339+0000","last_undegraded":"2023-09-23T08:28:25.171339+0000","last_fullsized":"2023-09-23T08:28:25.171339+0000","mapping_epoch":13,"log_start":"81'264207","ondisk_log_start":"81'264207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3006402842,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":275074,"num_read_kb":1086247,"num_write":273427,"num_write_kb":1093621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"83'267623","reported_seq":534025,"reported_epoch":83,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:28:24.275393+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:28:24.275393+0000","last_peered":"2023-09-23T08:28:24.275393+0000","last_clean":"2023-09-23T08:28:24.275393+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:28:24.275393+0000","last_undegraded":"2023-09-23T08:28:24.275393+0000","last_fullsized":"2023-09-23T08:28:24.275393+0000","mapping_epoch":13,"log_start":"81'257607","ondisk_log_start":"81'257607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":938,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 347s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2900312382,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":266319,"num_read_kb":1046155,"num_write":264500,"num_write_kb":1057850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"83'276551","reported_seq":549557,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:26.028566+0000","last_change":"2023-09-23T08:28:24.302698+0000","last_active":"2023-09-23T08:28:26.028566+0000","last_peered":"2023-09-23T08:28:26.028566+0000","last_clean":"2023-09-23T08:28:26.028566+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:28:26.028566+0000","last_undegraded":"2023-09-23T08:28:26.028566+0000","last_fullsized":"2023-09-23T08:28:26.028566+0000","mapping_epoch":13,"log_start":"81'266511","ondisk_log_start":"81'266511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2987647446,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":272719,"num_read_kb":1070340,"num_write":270928,"num_write_kb":1083592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"83'253528","reported_seq":503756,"reported_epoch":83,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:28:25.971288+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:28:25.971288+0000","last_peered":"2023-09-23T08:28:25.971288+0000","last_clean":"2023-09-23T08:28:25.971288+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:28:25.971288+0000","last_undegraded":"2023-09-23T08:28:25.971288+0000","last_fullsized":"2023-09-23T08:28:25.971288+0000","mapping_epoch":13,"log_start":"81'243508","ondisk_log_start":"81'243508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1126,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 345s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2709950765,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":249656,"num_read_kb":979869,"num_write":247190,"num_write_kb":988673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"83'267523","reported_seq":526167,"reported_epoch":83,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:28:25.067884+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:28:25.067884+0000","last_peered":"2023-09-23T08:28:25.067884+0000","last_clean":"2023-09-23T08:28:25.067884+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:28:25.067884+0000","last_undegraded":"2023-09-23T08:28:25.067884+0000","last_fullsized":"2023-09-23T08:28:25.067884+0000","mapping_epoch":13,"log_start":"81'257505","ondisk_log_start":"81'257505","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":780,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 343s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2781221398,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":258255,"num_read_kb":1013339,"num_write":254466,"num_write_kb":1017747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":255,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:27:16.964006+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:27:16.964006+0000","last_peered":"2023-09-23T08:27:16.964006+0000","last_clean":"2023-09-23T08:27:16.964006+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:27:16.964006+0000","last_undegraded":"2023-09-23T08:27:16.964006+0000","last_fullsized":"2023-09-23T08:27:16.964006+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22911900459,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2106100,"num_read_kb":8271095,"num_write":2085603,"num_write_kb":8341437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16947228672,"data_stored":21170812502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80282,"ondisk_log_size":80282,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739231,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4741940,"kb_used_data":3065896,"kb_used_omap":219,"kb_used_meta":1675812,"kb_avail":89629900,"statfs":{"total":96636764160,"available":91781017600,"internally_reserved":0,"allocated":3139477504,"data_stored":3912534509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1716032333},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,1,1,1,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.73499999999999999},"min":{"1min":0.20999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":4.6470000000000002,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.251},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82599999999999996,"15min":1.048},"min":{"1min":0.252,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":4.2569999999999997,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.313}]},{"osd":1,"last update":"Sat Sep 23 08:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.90000000000000002,"15min":0.93899999999999995},"min":{"1min":0.23499999999999999,"5min":0.215,"15min":0.215},"max":{"1min":3.9359999999999999,"5min":6.9870000000000001,"15min":25.550000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":1.667,"5min":1.792,"15min":1.1990000000000001},"min":{"1min":0.20899999999999999,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":14.311999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.23599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739220,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9614164,"kb_used_data":8275084,"kb_used_omap":676,"kb_used_meta":1338395,"kb_avail":84757676,"statfs":{"total":96636764160,"available":86791860224,"internally_reserved":0,"allocated":8473686016,"data_stored":10585694751,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":693144,"internal_metadata":1370516584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,2,9,2,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.73199999999999998,"15min":0.75800000000000001},"min":{"1min":0.21099999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":9.0440000000000005,"5min":9.0440000000000005,"15min":10.25},"last":0.27000000000000002},{"interface":"front","average":{"1min":1.871,"5min":1.776,"15min":1.2749999999999999},"min":{"1min":0.217,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":8.9749999999999996,"5min":14.914,"15min":15.291},"last":0.67900000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:27:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.107,"15min":0.96499999999999997},"min":{"1min":0.23599999999999999,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":9.0079999999999991,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.92500000000000004,"15min":0.90500000000000003},"min":{"1min":0.23499999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":7.0830000000000002,"5min":26.151,"15min":26.151},"last":0.51500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739226,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6816908,"kb_used_data":5209980,"kb_used_omap":378,"kb_used_meta":1606533,"kb_avail":87554932,"statfs":{"total":96636764160,"available":89656250368,"internally_reserved":0,"allocated":5335019520,"data_stored":6673571078,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":1645089917},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,1,0,4,7,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.73099999999999998,"15min":1.298},"min":{"1min":0.23000000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":3.0990000000000002,"5min":6.2409999999999997,"15min":21.207000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.878,"15min":0.88300000000000001},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.20300000000000001},"max":{"1min":4.0030000000000001,"5min":6.3090000000000002,"15min":20.436},"last":1.601}]},{"osd":2,"last update":"Sat Sep 23 08:27:37 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.17000000000000001},"max":{"1min":7.8490000000000002,"5min":9.0150000000000006,"15min":15.039999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.57099999999999995,"15min":0.76100000000000001},"min":{"1min":0.27200000000000002,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":4.7039999999999997,"5min":6.2809999999999997,"15min":21.757999999999999},"last":0.32600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5334376448,"data_stored":6672778770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8473755648,"data_stored":10585533227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3139096576,"data_stored":3912500505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:28:29.543 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:29.543 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:29.544 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:29.544 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:29.544 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:29.544 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:29.544 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:29.545 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:29.545 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:28:30.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:28:30.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:30.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:30.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:30.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:30.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:30.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:30.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:30.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:30.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:30.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:30.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:30.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:30.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:30.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:30.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:30.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:30.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:32.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:32.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:32.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:32.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:32.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:32.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:32.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:32.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:32.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:32.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:32.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:32.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:32.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:32.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:32.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:32.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:32.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:32.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:32.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:32.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:33.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:33.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:33.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:33.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:33.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:33.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:33.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:33.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:33.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:33.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:33.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:33.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:33.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:33.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:33.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:33.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:33.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:33.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:33.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:33.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:34.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:34.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:34.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:34.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:34.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:34.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:34.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:34.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:34.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:34.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:34.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:34.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:34.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:34.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:34.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:34.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:34.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:34.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:34.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:34.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:34.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:34.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:36.027 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:36.019+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:28:36.043 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:36.035+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:36.043 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:36.035+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:37.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:37.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:37.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:37.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:37.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:37.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:37.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:37.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:37.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:37.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:37.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:37.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:37.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:37.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:37.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:37.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:37.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:37.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:38.234 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:38.227+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:28:38.235 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:38.227+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:38.235 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:38.227+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:38.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:38.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:38.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:38.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:38.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:38.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:38.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:38.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:38.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:38.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:38.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:38.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:38.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:38.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:38.701 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:38.695+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:28:38.712 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:38.707+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:38.712 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:38.707+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:40.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:40.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:40.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:40.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:40.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:40.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:40.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:40.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:40.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:40.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:40.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:40.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:40.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:40.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:40.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:40.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:40.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:40.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:41.869 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:41.863+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:41.869 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:41.863+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:42.777 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:42.771+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:28:42.792 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:42.783+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:42.793 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:42.783+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:43.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:43.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:43.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:43.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:43.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:43.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:43.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:43.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:43.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:43.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:43.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:43.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:43.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:43.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:43.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:43.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:44.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:44.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:44.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:44.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:44.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:44.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:44.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:44.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:44.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:44.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:44.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:44.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:44.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:44.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:44.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:44.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:44.527 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:44.523+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:28:44.527 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:44.523+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:44.527 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:44.523+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:45.477 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:45.471+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:45.477 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:45.471+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:46.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:46.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:46.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:46.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:46.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:46.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:46.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:46.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:28:46.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:28:46.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:46.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:46.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:46.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:46.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:46.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:46.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:46.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:47.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:47.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:47.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:47.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:47.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:47.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:47.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:47.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:48.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:48.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:48.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:48.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:48.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:48.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:48.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:48.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:48.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:48.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:48.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:48.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:48.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:48.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:48.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:48.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:49.546 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:28:50.348 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:28:50.348 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:28:50.422 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2246,"stamp":"2023-09-23T08:28:50.342946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22930500939,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2114861,"num_read_kb":8305770,"num_write":2094379,"num_write_kb":8377887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80523,"ondisk_log_size":80523,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21533300,"kb_used_data":16593804,"kb_used_omap":1274,"kb_used_meta":4938181,"kb_avail":261582220,"statfs":{"total":289910292480,"available":267860193280,"internally_reserved":0,"allocated":16992055296,"data_stored":21209595979,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1305550,"internal_metadata":5056697394},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,6,12,16,7,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8830976,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4293,"num_read_kb":17152,"num_write":4173,"num_write_kb":16692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001742"},"pg_stats":[{"pgid":"2.7","version":"84'259350","reported_seq":509975,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:28:45.956126+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:28:45.956126+0000","last_peered":"2023-09-23T08:28:45.956126+0000","last_clean":"2023-09-23T08:28:45.956126+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:28:45.956126+0000","last_undegraded":"2023-09-23T08:28:45.956126+0000","last_fullsized":"2023-09-23T08:28:45.956126+0000","mapping_epoch":13,"log_start":"81'249310","ondisk_log_start":"81'249310","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2703401295,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":250265,"num_read_kb":982926,"num_write":246788,"num_write_kb":987056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"84'286009","reported_seq":562634,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:28:45.926123+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:28:45.926123+0000","last_peered":"2023-09-23T08:28:45.926123+0000","last_clean":"2023-09-23T08:28:45.926123+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:28:45.926123+0000","last_undegraded":"2023-09-23T08:28:45.926123+0000","last_fullsized":"2023-09-23T08:28:45.926123+0000","mapping_epoch":13,"log_start":"81'276007","ondisk_log_start":"81'276007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3017597247,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":277036,"num_read_kb":1084002,"num_write":273482,"num_write_kb":1093697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"84'270574","reported_seq":530805,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:28:45.925489+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:28:45.925489+0000","last_peered":"2023-09-23T08:28:45.925489+0000","last_clean":"2023-09-23T08:28:45.925489+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:28:45.925489+0000","last_undegraded":"2023-09-23T08:28:45.925489+0000","last_fullsized":"2023-09-23T08:28:45.925489+0000","mapping_epoch":13,"log_start":"81'260509","ondisk_log_start":"81'260509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2812211500,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":259857,"num_read_kb":1020529,"num_write":258032,"num_write_kb":1032041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"84'275296","reported_seq":550858,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:28:45.912204+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:28:45.912204+0000","last_peered":"2023-09-23T08:28:45.912204+0000","last_clean":"2023-09-23T08:28:45.912204+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:28:45.912204+0000","last_undegraded":"2023-09-23T08:28:45.912204+0000","last_fullsized":"2023-09-23T08:28:45.912204+0000","mapping_epoch":13,"log_start":"81'265207","ondisk_log_start":"81'265207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3008573722,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":276207,"num_read_kb":1090775,"num_write":274508,"num_write_kb":1097945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"84'268967","reported_seq":536676,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:28:49.593354+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:28:49.593354+0000","last_peered":"2023-09-23T08:28:49.593354+0000","last_clean":"2023-09-23T08:28:49.593354+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:28:49.593354+0000","last_undegraded":"2023-09-23T08:28:49.593354+0000","last_fullsized":"2023-09-23T08:28:49.593354+0000","mapping_epoch":13,"log_start":"81'258907","ondisk_log_start":"81'258907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":991,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 372s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2902950206,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":267606,"num_read_kb":1051299,"num_write":265791,"num_write_kb":1063014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"84'277650","reported_seq":551803,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:28:46.213449+0000","last_change":"2023-09-23T08:28:43.564867+0000","last_active":"2023-09-23T08:28:46.213449+0000","last_peered":"2023-09-23T08:28:46.213449+0000","last_clean":"2023-09-23T08:28:46.213449+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:28:46.213449+0000","last_undegraded":"2023-09-23T08:28:46.213449+0000","last_fullsized":"2023-09-23T08:28:46.213449+0000","mapping_epoch":13,"log_start":"81'267611","ondisk_log_start":"81'267611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2989928918,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":273849,"num_read_kb":1074848,"num_write":272000,"num_write_kb":1087880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"84'254565","reported_seq":505771,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:28:46.231595+0000","last_change":"2023-09-23T08:22:40.670610+0000","last_active":"2023-09-23T08:28:46.231595+0000","last_peered":"2023-09-23T08:28:46.231595+0000","last_clean":"2023-09-23T08:28:46.231595+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:28:46.231595+0000","last_undegraded":"2023-09-23T08:28:46.231595+0000","last_fullsized":"2023-09-23T08:28:46.231595+0000","mapping_epoch":13,"log_start":"81'244508","ondisk_log_start":"81'244508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1158,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 365s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2712043821,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":250614,"num_read_kb":983701,"num_write":248183,"num_write_kb":992645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"84'268577","reported_seq":528306,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:28:45.837224+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:28:45.837224+0000","last_peered":"2023-09-23T08:28:45.837224+0000","last_clean":"2023-09-23T08:28:45.837224+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:28:45.837224+0000","last_undegraded":"2023-09-23T08:28:45.837224+0000","last_fullsized":"2023-09-23T08:28:45.837224+0000","mapping_epoch":13,"log_start":"81'258505","ondisk_log_start":"81'258505","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":815,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 364s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2783203862,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":259321,"num_read_kb":1017599,"num_write":255458,"num_write_kb":1021715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":256,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:19.979121+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:28:19.979121+0000","last_peered":"2023-09-23T08:28:19.979121+0000","last_clean":"2023-09-23T08:28:19.979121+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:28:19.979121+0000","last_undegraded":"2023-09-23T08:28:19.979121+0000","last_fullsized":"2023-09-23T08:28:19.979121+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22929910571,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2114755,"num_read_kb":8305679,"num_write":2094242,"num_write_kb":8375993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16990543872,"data_stored":21208159830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80424,"ondisk_log_size":80424,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739235,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4822184,"kb_used_data":3073120,"kb_used_omap":219,"kb_used_meta":1748836,"kb_avail":89549656,"statfs":{"total":96636764160,"available":91698847744,"internally_reserved":0,"allocated":3146874880,"data_stored":3918821120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1790808909},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,5,4,1,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.73499999999999999},"min":{"1min":0.20999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":4.6470000000000002,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82599999999999996,"15min":1.048},"min":{"1min":0.252,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":4.2569999999999997,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.26900000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.90000000000000002,"15min":0.93899999999999995},"min":{"1min":0.23499999999999999,"5min":0.215,"15min":0.215},"max":{"1min":3.9359999999999999,"5min":6.9870000000000001,"15min":25.550000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.667,"5min":1.792,"15min":1.1990000000000001},"min":{"1min":0.20899999999999999,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":14.311999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.25600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739224,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9780492,"kb_used_data":8295548,"kb_used_omap":676,"kb_used_meta":1484251,"kb_avail":84591348,"statfs":{"total":96636764160,"available":86621540352,"internally_reserved":0,"allocated":8494641152,"data_stored":10603773746,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":693144,"internal_metadata":1519873128},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,4,7,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:27:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.73199999999999998,"15min":0.75800000000000001},"min":{"1min":0.21099999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":9.0440000000000005,"5min":9.0440000000000005,"15min":10.25},"last":0.23499999999999999},{"interface":"front","average":{"1min":1.871,"5min":1.776,"15min":1.2749999999999999},"min":{"1min":0.217,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":8.9749999999999996,"5min":14.914,"15min":15.291},"last":0.30599999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:27:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.107,"15min":0.96499999999999997},"min":{"1min":0.23599999999999999,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":9.0079999999999991,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.92500000000000004,"15min":0.90500000000000003},"min":{"1min":0.23499999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":7.0830000000000002,"5min":26.151,"15min":26.151},"last":0.27700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739231,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6930624,"kb_used_data":5225136,"kb_used_omap":378,"kb_used_meta":1705093,"kb_avail":87441216,"statfs":{"total":96636764160,"available":89539805184,"internally_reserved":0,"allocated":5350539264,"data_stored":6687001113,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":1746015357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,4,3,5,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.73099999999999998,"15min":1.298},"min":{"1min":0.23000000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":3.0990000000000002,"5min":6.2409999999999997,"15min":21.207000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.878,"15min":0.88300000000000001},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.20300000000000001},"max":{"1min":4.0030000000000001,"5min":6.3090000000000002,"15min":20.436},"last":0.52100000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.193,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":4.6269999999999998,"5min":7.8490000000000002,"15min":15.039999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.69899999999999995,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":5.1020000000000003,"5min":6.2809999999999997,"15min":21.757999999999999},"last":0.48999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5350002688,"data_stored":6686311954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8494120960,"data_stored":10603096875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3146420224,"data_stored":3918751001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:28:50.423 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:50.424 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:50.424 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:50.424 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:50.424 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:50.425 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:50.425 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:50.425 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:28:50.425 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:28:50.884 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:50.879+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:28:50.884 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:50.879+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:50.884 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:50.879+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:51.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:51.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:51.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:51.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:51.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:51.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:51.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:51.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:51.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:51.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:51.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:51.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:51.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:51.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:51.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:51.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:51.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:51.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:51.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:51.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:52.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:52.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:52.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:52.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:52.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:52.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:52.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:52.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:28:52.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:52.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:52.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:52.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:52.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:52.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:52.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:52.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:52.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:52.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:52.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:56.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:55.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:56.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:55.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:56.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:56.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:56.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:56.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:56.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:56.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:56.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:56.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:56.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:56.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:56.083 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:56.079+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:28:56.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:56.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:56.095 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:56.091+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:28:56.095 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:56.091+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:28:56.102 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:56.095+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:28:56.102 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:56.095+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:28:56.102 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:28:56.095+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:28:57.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:57.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:57.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:57.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:57.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:57.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:57.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:57.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:57.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:57.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:28:57.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:57.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:57.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:57.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:57.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:58.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:58.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:59.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:59.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:28:59.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:28:59.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:28:59.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:28:59.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:28:59.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:28:59.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:28:59.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:28:59.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:28:59.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:00.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:28:59.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:00.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:00.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:00.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:00.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:00.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:00.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:00.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:00.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:00.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:00.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:00.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:00.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:01.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:01.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:01.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:01.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:01.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:01.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:01.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:01.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:01.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:01.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:01.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:01.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:01.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:01.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:01.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:01.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:01.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:01.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:05.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:05.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:05.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:05.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:05.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:05.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:05.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:05.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:05.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:05.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:05.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:05.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:05.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:05.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:05.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:05.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:05.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:05.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:05.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:05.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:08.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:08.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:08.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:08.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:08.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:08.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:08.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:08.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:08.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:08.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:08.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:08.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:08.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:08.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:08.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:08.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:08.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:08.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:09.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:09.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:09.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:09.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:10.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:10.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:10.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:10.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:10.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:10.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:10.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:10.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:10.427 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:29:10.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:10.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:29:10.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:10.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:10.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:10.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:10.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:10.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:10.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:10.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:10.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:10.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:10.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:11.187 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:29:11.187 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:29:11.245 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2256,"stamp":"2023-09-23T08:29:10.347465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22946983243,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2123006,"num_read_kb":8338334,"num_write":2102391,"num_write_kb":8409935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80475,"ondisk_log_size":80475,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21820344,"kb_used_data":16630556,"kb_used_omap":1274,"kb_used_meta":5188485,"kb_avail":261295176,"statfs":{"total":289910292480,"available":267566260224,"internally_reserved":0,"allocated":17029689344,"data_stored":21241921611,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1305550,"internal_metadata":5313008690},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,4,4,3,10,10,25,8,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8429568,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4139,"num_read_kb":16552,"num_write":4109,"num_write_kb":16436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003127"},"pg_stats":[{"pgid":"2.7","version":"84'260325","reported_seq":511976,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:06.435890+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:29:06.435890+0000","last_peered":"2023-09-23T08:29:06.435890+0000","last_clean":"2023-09-23T08:29:06.435890+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:29:06.435890+0000","last_undegraded":"2023-09-23T08:29:06.435890+0000","last_fullsized":"2023-09-23T08:29:06.435890+0000","mapping_epoch":13,"log_start":"81'250310","ondisk_log_start":"81'250310","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2705228111,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":251279,"num_read_kb":986978,"num_write":247721,"num_write_kb":990788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"84'287148","reported_seq":564843,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:06.463926+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:29:06.463926+0000","last_peered":"2023-09-23T08:29:06.463926+0000","last_clean":"2023-09-23T08:29:06.463926+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:29:06.463926+0000","last_undegraded":"2023-09-23T08:29:06.463926+0000","last_fullsized":"2023-09-23T08:29:06.463926+0000","mapping_epoch":13,"log_start":"82'277107","ondisk_log_start":"82'277107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3019874623,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":278092,"num_read_kb":1088226,"num_write":274579,"num_write_kb":1098085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"84'271587","reported_seq":532805,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:06.467979+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:29:06.467979+0000","last_peered":"2023-09-23T08:29:06.467979+0000","last_clean":"2023-09-23T08:29:06.467979+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:29:06.467979+0000","last_undegraded":"2023-09-23T08:29:06.467979+0000","last_fullsized":"2023-09-23T08:29:06.467979+0000","mapping_epoch":13,"log_start":"81'261509","ondisk_log_start":"81'261509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2814177580,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":260837,"num_read_kb":1024449,"num_write":259003,"num_write_kb":1035925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"84'276365","reported_seq":553025,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:06.440318+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:29:06.440318+0000","last_peered":"2023-09-23T08:29:06.440318+0000","last_clean":"2023-09-23T08:29:06.440318+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:29:06.440318+0000","last_undegraded":"2023-09-23T08:29:06.440318+0000","last_fullsized":"2023-09-23T08:29:06.440318+0000","mapping_epoch":13,"log_start":"81'266307","ondisk_log_start":"81'266307","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3010642202,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":277302,"num_read_kb":1095155,"num_write":275577,"num_write_kb":1102221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"84'269987","reported_seq":538704,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:29:09.821400+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:29:09.821400+0000","last_peered":"2023-09-23T08:29:09.821400+0000","last_clean":"2023-09-23T08:29:09.821400+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:29:09.821400+0000","last_undegraded":"2023-09-23T08:29:09.821400+0000","last_fullsized":"2023-09-23T08:29:09.821400+0000","mapping_epoch":13,"log_start":"81'259907","ondisk_log_start":"81'259907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1070,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 392s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2904965438,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":268601,"num_read_kb":1055279,"num_write":266762,"num_write_kb":1066898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"84'278739","reported_seq":553981,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:29:06.444513+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:29:06.444513+0000","last_peered":"2023-09-23T08:29:06.444513+0000","last_clean":"2023-09-23T08:29:06.444513+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:29:06.444513+0000","last_undegraded":"2023-09-23T08:29:06.444513+0000","last_fullsized":"2023-09-23T08:29:06.444513+0000","mapping_epoch":13,"log_start":"81'268711","ondisk_log_start":"81'268711","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":5,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 6s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2992103894,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":274915,"num_read_kb":1079108,"num_write":273059,"num_write_kb":1092116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"84'255544","reported_seq":507755,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:06.413805+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:29:06.413805+0000","last_peered":"2023-09-23T08:29:06.413805+0000","last_clean":"2023-09-23T08:29:06.413805+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:29:06.413805+0000","last_undegraded":"2023-09-23T08:29:06.413805+0000","last_fullsized":"2023-09-23T08:29:06.413805+0000","mapping_epoch":13,"log_start":"81'245508","ondisk_log_start":"81'245508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2714042669,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":251594,"num_read_kb":987613,"num_write":249116,"num_write_kb":996377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"84'269645","reported_seq":530353,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:29:06.456933+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:29:06.456933+0000","last_peered":"2023-09-23T08:29:06.456933+0000","last_clean":"2023-09-23T08:29:06.456933+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:29:06.456933+0000","last_undegraded":"2023-09-23T08:29:06.456933+0000","last_fullsized":"2023-09-23T08:29:06.456933+0000","mapping_epoch":13,"log_start":"81'259605","ondisk_log_start":"81'259605","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":896,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 385s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2785358358,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":260280,"num_read_kb":1021435,"num_write":256437,"num_write_kb":1025631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":256,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:19.979121+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:28:19.979121+0000","last_peered":"2023-09-23T08:28:19.979121+0000","last_clean":"2023-09-23T08:28:19.979121+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:28:19.979121+0000","last_undegraded":"2023-09-23T08:28:19.979121+0000","last_fullsized":"2023-09-23T08:28:19.979121+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22946392875,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2122900,"num_read_kb":8338243,"num_write":2102254,"num_write_kb":8408041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17028894720,"data_stored":21241083478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80376,"ondisk_log_size":80376,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739239,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4877692,"kb_used_data":3080052,"kb_used_omap":219,"kb_used_meta":1797412,"kb_avail":89494148,"statfs":{"total":96636764160,"available":91642007552,"internally_reserved":0,"allocated":3153973248,"data_stored":3924879104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1840550733},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,3,4,14,7,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82299999999999995,"15min":0.73499999999999999},"min":{"1min":0.20999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":4.6470000000000002,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82599999999999996,"15min":1.048},"min":{"1min":0.252,"5min":0.224,"15min":0.20499999999999999},"max":{"1min":4.2569999999999997,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.90000000000000002,"15min":0.93899999999999995},"min":{"1min":0.23499999999999999,"5min":0.215,"15min":0.215},"max":{"1min":3.9359999999999999,"5min":6.9870000000000001,"15min":25.550000000000001},"last":0.497},{"interface":"front","average":{"1min":1.667,"5min":1.792,"15min":1.1990000000000001},"min":{"1min":0.20899999999999999,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":14.311999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.36799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739228,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9924244,"kb_used_data":8313928,"kb_used_omap":676,"kb_used_meta":1609627,"kb_avail":84447596,"statfs":{"total":96636764160,"available":86474338304,"internally_reserved":0,"allocated":8513462272,"data_stored":10619948850,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":693144,"internal_metadata":1648258152},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,4,1,4,1,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:28:59 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":0.92600000000000005,"15min":0.82399999999999995},"min":{"1min":0.22500000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":9.1560000000000006,"5min":9.1560000000000006,"15min":10.25},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.5509999999999999,"15min":1.3009999999999999},"min":{"1min":0.19700000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.8490000000000002,"5min":11.390000000000001,"15min":15.291},"last":0.81299999999999994}]},{"osd":2,"last update":"Sat Sep 23 08:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":1.05,"15min":0.93200000000000005},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":1.0269999999999999,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1,"15min":0.92900000000000005},"min":{"1min":0.27700000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":6.1859999999999999,"5min":26.151,"15min":26.151},"last":0.26100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739235,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7018408,"kb_used_data":5236576,"kb_used_omap":378,"kb_used_meta":1781445,"kb_avail":87353432,"statfs":{"total":96636764160,"available":89449914368,"internally_reserved":0,"allocated":5362253824,"data_stored":6697093657,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":1824199805},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,0,2,3,5,3,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":1.2889999999999999},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":5.6589999999999998,"5min":6.2409999999999997,"15min":21.207000000000001},"last":4.9020000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.94299999999999995,"15min":0.92100000000000004},"min":{"1min":0.222,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":5.6920000000000002,"5min":6.3090000000000002,"15min":20.436},"last":4.9379999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.193,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":4.6269999999999998,"5min":7.8490000000000002,"15min":15.039999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.69899999999999995,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":5.1020000000000003,"5min":6.2809999999999997,"15min":21.757999999999999},"last":0.26300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5361831936,"data_stored":6696498706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8513413120,"data_stored":10619661099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3153649664,"data_stored":3924923673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:29:11.246 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:11.246 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:11.246 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:11.246 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:11.247 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:11.247 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:11.247 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:11.247 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:29:12.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:12.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:12.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:12.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:12.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:12.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:12.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:12.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:12.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:12.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:12.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:12.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:12.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:12.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:12.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:12.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:13.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:12.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:13.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:13.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:13.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:13.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:13.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:13.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:13.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:13.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:13.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:13.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:13.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:13.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:17.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:17.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:17.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:17.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:17.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:17.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:17.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:17.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:17.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:17.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:17.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:17.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:17.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:17.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:17.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:17.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:18.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:18.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:18.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:18.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:18.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:18.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:18.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:18.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:18.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:18.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:18.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:18.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:18.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:18.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:18.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:18.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:18.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:18.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:21.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:21.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:21.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:21.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:21.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:21.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:21.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:21.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:21.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:21.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:21.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:21.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:21.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:21.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:21.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:21.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:21.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:21.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:23.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:23.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:23.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:23.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:23.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:23.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:23.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:23.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:23.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:23.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:23.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:23.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:23.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:23.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:23.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:23.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:23.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:24.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:24.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:24.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:24.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:24.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:24.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:24.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:24.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:24.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:24.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:24.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:24.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:24.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:24.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:24.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:24.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:24.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:24.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:24.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:24.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:24.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:24.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:25.802 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:29:25.794+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:29:26.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:26.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:26.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:26.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:26.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:26.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:26.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:26.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:26.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:26.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:26.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:26.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:26.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:26.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:26.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:26.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:26.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:26.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:26.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:26.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:28.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:29:28.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:28.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:28.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:28.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:28.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:28.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:28.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:28.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:28.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:28.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:28.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:28.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:29.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:29.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:29.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:29.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:29.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:29.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:29.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:29.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:29.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:29.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:29.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:29.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:30.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:30.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:30.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:30.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:30.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:30.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:30.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:30.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:30.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:30.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:30.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:30.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:30.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:30.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:30.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:30.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:30.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:30.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:30.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:30.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:31.248 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:29:31.834 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:29:31.826+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:29:31.853 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:29:31.846+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:29:31.853 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:29:31.846+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:29:31.853 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:29:31.846+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:29:32.197 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:29:32.197 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:29:32.254 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2266,"stamp":"2023-09-23T08:29:30.355333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22963871051,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2131334,"num_read_kb":8371646,"num_write":2110497,"num_write_kb":8442359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80448,"ondisk_log_size":80448,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22067116,"kb_used_data":16668756,"kb_used_omap":1274,"kb_used_meta":5397061,"kb_avail":261048404,"statfs":{"total":289910292480,"available":267313565696,"internally_reserved":0,"allocated":17068806144,"data_stored":21275705419,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1305550,"internal_metadata":5526590514},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,10,12,5,15,22,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9031680,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4362,"num_read_kb":17448,"num_write":4329,"num_write_kb":17316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006617"},"pg_stats":[{"pgid":"2.7","version":"84'261350","reported_seq":514018,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:26.908184+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:29:26.908184+0000","last_peered":"2023-09-23T08:29:26.908184+0000","last_clean":"2023-09-23T08:29:26.908184+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:29:26.908184+0000","last_undegraded":"2023-09-23T08:29:26.908184+0000","last_fullsized":"2023-09-23T08:29:26.908184+0000","mapping_epoch":13,"log_start":"81'251310","ondisk_log_start":"81'251310","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2707124559,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":252285,"num_read_kb":991002,"num_write":248704,"num_write_kb":994720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"84'288243","reported_seq":567057,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:26.902053+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:29:26.902053+0000","last_peered":"2023-09-23T08:29:26.902053+0000","last_clean":"2023-09-23T08:29:26.902053+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:29:26.902053+0000","last_undegraded":"2023-09-23T08:29:26.902053+0000","last_fullsized":"2023-09-23T08:29:26.902053+0000","mapping_epoch":13,"log_start":"82'278207","ondisk_log_start":"82'278207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3022242111,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":279198,"num_read_kb":1092650,"num_write":275632,"num_write_kb":1102297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"84'272648","reported_seq":534882,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:26.885923+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:29:26.885923+0000","last_peered":"2023-09-23T08:29:26.885923+0000","last_clean":"2023-09-23T08:29:26.885923+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:29:26.885923+0000","last_undegraded":"2023-09-23T08:29:26.885923+0000","last_fullsized":"2023-09-23T08:29:26.885923+0000","mapping_epoch":13,"log_start":"82'262609","ondisk_log_start":"82'262609","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2816209196,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":261835,"num_read_kb":1028441,"num_write":260022,"num_write_kb":1040001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"84'277449","reported_seq":555226,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:26.887631+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:29:26.887631+0000","last_peered":"2023-09-23T08:29:26.887631+0000","last_clean":"2023-09-23T08:29:26.887631+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:29:26.887631+0000","last_undegraded":"2023-09-23T08:29:26.887631+0000","last_fullsized":"2023-09-23T08:29:26.887631+0000","mapping_epoch":13,"log_start":"82'267407","ondisk_log_start":"82'267407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3012972826,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":278418,"num_read_kb":1099619,"num_write":276661,"num_write_kb":1106557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"84'271032","reported_seq":540776,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:29:30.041008+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:29:30.041008+0000","last_peered":"2023-09-23T08:29:30.041008+0000","last_clean":"2023-09-23T08:29:30.041008+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:29:30.041008+0000","last_undegraded":"2023-09-23T08:29:30.041008+0000","last_fullsized":"2023-09-23T08:29:30.041008+0000","mapping_epoch":13,"log_start":"82'261007","ondisk_log_start":"82'261007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1099,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 412s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2907066686,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":269611,"num_read_kb":1059319,"num_write":267785,"num_write_kb":1070990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"84'279830","reported_seq":556170,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:29:26.669093+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:29:26.669093+0000","last_peered":"2023-09-23T08:29:26.669093+0000","last_clean":"2023-09-23T08:29:26.669093+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:29:26.669093+0000","last_undegraded":"2023-09-23T08:29:26.669093+0000","last_fullsized":"2023-09-23T08:29:26.669093+0000","mapping_epoch":13,"log_start":"82'269811","ondisk_log_start":"82'269811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":42,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 26s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2994356694,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":276000,"num_read_kb":1083448,"num_write":274111,"num_write_kb":1096324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"84'256495","reported_seq":509747,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:26.683291+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:29:26.683291+0000","last_peered":"2023-09-23T08:29:26.683291+0000","last_clean":"2023-09-23T08:29:26.683291+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:29:26.683291+0000","last_undegraded":"2023-09-23T08:29:26.683291+0000","last_fullsized":"2023-09-23T08:29:26.683291+0000","mapping_epoch":13,"log_start":"81'246408","ondisk_log_start":"81'246408","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2716057901,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":252623,"num_read_kb":991729,"num_write":250049,"num_write_kb":1000109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"84'270666","reported_seq":532373,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:29:26.880234+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:29:26.880234+0000","last_peered":"2023-09-23T08:29:26.880234+0000","last_clean":"2023-09-23T08:29:26.880234+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:29:26.880234+0000","last_undegraded":"2023-09-23T08:29:26.880234+0000","last_fullsized":"2023-09-23T08:29:26.880234+0000","mapping_epoch":13,"log_start":"82'260605","ondisk_log_start":"82'260605","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":930,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 405s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2787250710,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":261258,"num_read_kb":1025347,"num_write":257396,"num_write_kb":1029467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":256,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:19.979121+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:28:19.979121+0000","last_peered":"2023-09-23T08:28:19.979121+0000","last_clean":"2023-09-23T08:28:19.979121+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:28:19.979121+0000","last_undegraded":"2023-09-23T08:28:19.979121+0000","last_fullsized":"2023-09-23T08:28:19.979121+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22963280683,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2131228,"num_read_kb":8371555,"num_write":2110360,"num_write_kb":8440465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17067839488,"data_stored":21274728022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80349,"ondisk_log_size":80349,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739243,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4934884,"kb_used_data":3087260,"kb_used_omap":219,"kb_used_meta":1847396,"kb_avail":89436956,"statfs":{"total":96636764160,"available":91583442944,"internally_reserved":0,"allocated":3161354240,"data_stored":3931260672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1891734349},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,3,0,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.64100000000000001,"15min":0.71799999999999997},"min":{"1min":0.184,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.55600000000000005,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.75600000000000001,"15min":1.01},"min":{"1min":0.222,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":3.9980000000000002,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.307}]},{"osd":1,"last update":"Sat Sep 23 08:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90200000000000002,"15min":0.97199999999999998},"min":{"1min":0.251,"5min":0.215,"15min":0.215},"max":{"1min":4.6799999999999997,"5min":6.9870000000000001,"15min":25.550000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":1.028,"5min":1.6160000000000001,"15min":1.2250000000000001},"min":{"1min":0.20899999999999999,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":6.1840000000000002,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.25700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739232,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10073584,"kb_used_data":8332776,"kb_used_omap":676,"kb_used_meta":1740123,"kb_avail":84298256,"statfs":{"total":96636764160,"available":86321414144,"internally_reserved":0,"allocated":8532762624,"data_stored":10636594994,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":693144,"internal_metadata":1781886056},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,5,5,4,10,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:28:59 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":0.92600000000000005,"15min":0.82399999999999995},"min":{"1min":0.22500000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":9.1560000000000006,"5min":9.1560000000000006,"15min":10.25},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.5509999999999999,"15min":1.3009999999999999},"min":{"1min":0.19700000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.8490000000000002,"5min":11.390000000000001,"15min":15.291},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":1.05,"15min":0.93200000000000005},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":1.0269999999999999,"5min":26.117000000000001,"15min":26.117000000000001},"last":4.0839999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1,"15min":0.92900000000000005},"min":{"1min":0.27700000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":6.1859999999999999,"5min":26.151,"15min":26.151},"last":3.891}]}]},{"osd":0,"up_from":8,"seq":34359739239,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7058648,"kb_used_data":5248720,"kb_used_omap":378,"kb_used_meta":1809541,"kb_avail":87313192,"statfs":{"total":96636764160,"available":89408708608,"internally_reserved":0,"allocated":5374689280,"data_stored":6707849753,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":1852970109},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5,4,1,4,9,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":1.2889999999999999},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":5.6589999999999998,"5min":6.2409999999999997,"15min":21.207000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.94299999999999995,"15min":0.92100000000000004},"min":{"1min":0.222,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":5.6920000000000002,"5min":6.3090000000000002,"15min":20.436},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:28:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.193,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":4.6269999999999998,"5min":7.8490000000000002,"15min":15.039999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.69899999999999995,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.218,"15min":0.19900000000000001},"max":{"1min":5.1020000000000003,"5min":6.2809999999999997,"15min":21.757999999999999},"last":0.317}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5374173184,"data_stored":6707181074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8532934656,"data_stored":10636512043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3160731648,"data_stored":3931034905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:29:32.255 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:32.255 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:32.255 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:32.256 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:32.256 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:32.256 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:32.256 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:32.256 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:29:32.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:32.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:32.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:32.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:32.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:32.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:32.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:32.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:32.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:32.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:32.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:32.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:32.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:32.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:32.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:32.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:32.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:32.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:33.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:33.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:33.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:33.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:33.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:33.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:33.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:33.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:33.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:33.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:33.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:33.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:33.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:33.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:33.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:33.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:33.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:33.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:34.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:34.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:34.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:34.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:34.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:34.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:34.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:34.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:34.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:34.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:34.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:34.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:34.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:34.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:34.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:34.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:34.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:34.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:34.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:34.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:34.900 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:29:34.894+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:29:34.900 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:29:34.894+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:29:38.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:38.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:38.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:38.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:38.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:38.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:38.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:38.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:38.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:38.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:38.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:38.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:38.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:38.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:39.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:39.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:39.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:39.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:39.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:39.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:39.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:39.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:39.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:39.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:39.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:39.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:39.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:39.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:39.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:40.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:40.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:40.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:40.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:40.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:40.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:40.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:40.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:40.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:40.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:40.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:40.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:40.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:40.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:40.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:40.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:40.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:40.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:40.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:40.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:41.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:41.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:41.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:41.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:41.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:41.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:41.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:41.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:41.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:41.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:41.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:41.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:41.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:41.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:42.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:42.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:42.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:42.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:42.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:42.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:42.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:42.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:42.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:42.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:42.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:42.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:42.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:42.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:44.007 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:29:44.002+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:29:44.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:44.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:44.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:44.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:44.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:44.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:44.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:44.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:44.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:44.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:44.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:44.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:44.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:44.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:44.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:44.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:44.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:44.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:44.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:44.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:44.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:44.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:48.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:48.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:48.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:48.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:48.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:48.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:48.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:48.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:48.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:48.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:48.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:48.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:48.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:48.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:48.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:48.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:48.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:48.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:49.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:49.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:49.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:49.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:49.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:49.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:49.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:49.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:49.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:29:49.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:49.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:49.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:50.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:50.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:50.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:50.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:50.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:50.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:50.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:50.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:50.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:50.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:50.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:50.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:50.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:50.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:29:50.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:50.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:50.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:50.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:50.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:50.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:50.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:50.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:50.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:50.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:50.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:51.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:51.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:51.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:51.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:51.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:51.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:51.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:51.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:51.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:51.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:52.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:51.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:52.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:52.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:52.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:52.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:52.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:52.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:52.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:52.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:52.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:29:52.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:52.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:29:52.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:52.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:52.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:29:52.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:52.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:52.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:52.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:52.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:52.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:52.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:29:53.080 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:29:53.162 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2278,"stamp":"2023-09-23T08:29:52.366846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22981860683,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2140247,"num_read_kb":8407298,"num_write":2119144,"num_write_kb":8476947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80507,"ondisk_log_size":80507,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22351168,"kb_used_data":16709280,"kb_used_omap":1274,"kb_used_meta":5640581,"kb_avail":260764352,"statfs":{"total":289910292480,"available":267022696448,"internally_reserved":0,"allocated":17110302720,"data_stored":21311692875,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1305550,"internal_metadata":5775954994},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,4,10,11,13,21,8],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5672960,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2814,"num_read_kb":11256,"num_write":2727,"num_write_kb":10908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.007900"},"pg_stats":[{"pgid":"2.7","version":"84'262415","reported_seq":516079,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:47.401146+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:29:47.401146+0000","last_peered":"2023-09-23T08:29:47.401146+0000","last_clean":"2023-09-23T08:29:47.401146+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:29:47.401146+0000","last_undegraded":"2023-09-23T08:29:47.401146+0000","last_fullsized":"2023-09-23T08:29:47.401146+0000","mapping_epoch":13,"log_start":"82'252410","ondisk_log_start":"82'252410","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2709238095,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":253269,"num_read_kb":994938,"num_write":249724,"num_write_kb":998800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"84'289390","reported_seq":569279,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:47.379724+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:29:47.379724+0000","last_peered":"2023-09-23T08:29:47.379724+0000","last_clean":"2023-09-23T08:29:47.379724+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:29:47.379724+0000","last_undegraded":"2023-09-23T08:29:47.379724+0000","last_fullsized":"2023-09-23T08:29:47.379724+0000","mapping_epoch":13,"log_start":"82'279307","ondisk_log_start":"82'279307","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3024511295,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":280262,"num_read_kb":1096906,"num_write":276734,"num_write_kb":1106705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"84'273736","reported_seq":537028,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:47.347855+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:29:47.347855+0000","last_peered":"2023-09-23T08:29:47.347855+0000","last_clean":"2023-09-23T08:29:47.347855+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:29:47.347855+0000","last_undegraded":"2023-09-23T08:29:47.347855+0000","last_fullsized":"2023-09-23T08:29:47.347855+0000","mapping_epoch":13,"log_start":"82'263709","ondisk_log_start":"82'263709","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2818400556,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":262881,"num_read_kb":1032625,"num_write":261065,"num_write_kb":1044173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"84'278503","reported_seq":557374,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:47.373677+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:29:47.373677+0000","last_peered":"2023-09-23T08:29:47.373677+0000","last_clean":"2023-09-23T08:29:47.373677+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:29:47.373677+0000","last_undegraded":"2023-09-23T08:29:47.373677+0000","last_fullsized":"2023-09-23T08:29:47.373677+0000","mapping_epoch":13,"log_start":"82'268407","ondisk_log_start":"82'268407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3015262490,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":279513,"num_read_kb":1103999,"num_write":277715,"num_write_kb":1110773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"84'272106","reported_seq":542941,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:29:50.201929+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:29:50.201929+0000","last_peered":"2023-09-23T08:29:50.201929+0000","last_clean":"2023-09-23T08:29:50.201929+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:29:50.201929+0000","last_undegraded":"2023-09-23T08:29:50.201929+0000","last_fullsized":"2023-09-23T08:29:50.201929+0000","mapping_epoch":13,"log_start":"82'262008","ondisk_log_start":"82'262008","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1141,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 432s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2909249854,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":270683,"num_read_kb":1063607,"num_write":268823,"num_write_kb":1075142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"84'281141","reported_seq":558855,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:29:51.862052+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:29:51.862052+0000","last_peered":"2023-09-23T08:29:51.862052+0000","last_clean":"2023-09-23T08:29:51.862052+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:29:51.862052+0000","last_undegraded":"2023-09-23T08:29:51.862052+0000","last_fullsized":"2023-09-23T08:29:51.862052+0000","mapping_epoch":13,"log_start":"82'271111","ondisk_log_start":"82'271111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":95,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 51s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2997047766,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":277346,"num_read_kb":1088832,"num_write":275364,"num_write_kb":1101336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"84'257638","reported_seq":512174,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:29:51.856036+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:29:51.856036+0000","last_peered":"2023-09-23T08:29:51.856036+0000","last_clean":"2023-09-23T08:29:51.856036+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:29:51.856036+0000","last_undegraded":"2023-09-23T08:29:51.856036+0000","last_fullsized":"2023-09-23T08:29:51.856036+0000","mapping_epoch":13,"log_start":"82'247608","ondisk_log_start":"82'247608","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2718433581,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":253894,"num_read_kb":996813,"num_write":251168,"num_write_kb":1004585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"84'271744","reported_seq":534510,"reported_epoch":84,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:29:47.365355+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:29:47.365355+0000","last_peered":"2023-09-23T08:29:47.365355+0000","last_clean":"2023-09-23T08:29:47.365355+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:29:47.365355+0000","last_undegraded":"2023-09-23T08:29:47.365355+0000","last_fullsized":"2023-09-23T08:29:47.365355+0000","mapping_epoch":13,"log_start":"82'261705","ondisk_log_start":"82'261705","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":954,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 426s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2789126678,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":262293,"num_read_kb":1029487,"num_write":258414,"num_write_kb":1033539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":256,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-23T08:28:19.979121+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:28:19.979121+0000","last_peered":"2023-09-23T08:28:19.979121+0000","last_clean":"2023-09-23T08:28:19.979121+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:28:19.979121+0000","last_undegraded":"2023-09-23T08:28:19.979121+0000","last_fullsized":"2023-09-23T08:28:19.979121+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22981270315,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2140141,"num_read_kb":8407207,"num_write":2119007,"num_write_kb":8475053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17108860928,"data_stored":21310346838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80408,"ondisk_log_size":80408,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739248,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4979376,"kb_used_data":3095656,"kb_used_omap":219,"kb_used_meta":1883492,"kb_avail":89392464,"statfs":{"total":96636764160,"available":91537883136,"internally_reserved":0,"allocated":3169951744,"data_stored":3938678528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1928696653},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,8,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.64100000000000001,"15min":0.71799999999999997},"min":{"1min":0.184,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.55600000000000005,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.315},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.75600000000000001,"15min":1.01},"min":{"1min":0.222,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":3.9980000000000002,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.36899999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:29:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90200000000000002,"15min":0.97199999999999998},"min":{"1min":0.251,"5min":0.215,"15min":0.215},"max":{"1min":4.6799999999999997,"5min":6.9870000000000001,"15min":25.550000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":1.028,"5min":1.6160000000000001,"15min":1.2250000000000001},"min":{"1min":0.20899999999999999,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":6.1840000000000002,"5min":14.311999999999999,"15min":14.311999999999999},"last":5.6109999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739236,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10216048,"kb_used_data":8352612,"kb_used_omap":676,"kb_used_meta":1862747,"kb_avail":84155792,"statfs":{"total":96636764160,"available":86175531008,"internally_reserved":0,"allocated":8553074688,"data_stored":10654240562,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":693144,"internal_metadata":1907453032},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,1,6,9,1,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:28:59 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":0.92600000000000005,"15min":0.82399999999999995},"min":{"1min":0.22500000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":9.1560000000000006,"5min":9.1560000000000006,"15min":10.25},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.5509999999999999,"15min":1.3009999999999999},"min":{"1min":0.19700000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.8490000000000002,"5min":11.390000000000001,"15min":15.291},"last":0.59199999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":1.05,"15min":0.93200000000000005},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":1.0269999999999999,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1,"15min":0.92900000000000005},"min":{"1min":0.27700000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":6.1859999999999999,"5min":26.151,"15min":26.151},"last":0.436}]}]},{"osd":0,"up_from":8,"seq":34359739243,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7155744,"kb_used_data":5261012,"kb_used_omap":378,"kb_used_meta":1894341,"kb_avail":87216096,"statfs":{"total":96636764160,"available":89309282304,"internally_reserved":0,"allocated":5387276288,"data_stored":6718773785,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":387971,"internal_metadata":1939805309},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,4,0,4,7,7],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":1.2889999999999999},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":5.6589999999999998,"5min":6.2409999999999997,"15min":21.207000000000001},"last":0.441},{"interface":"front","average":{"1min":0.88,"5min":0.94299999999999995,"15min":0.92100000000000004},"min":{"1min":0.222,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":5.6920000000000002,"5min":6.3090000000000002,"15min":20.436},"last":0.47199999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":0.91600000000000004,"15min":0.78700000000000003},"min":{"1min":0.23200000000000001,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":12.529,"5min":12.529,"15min":15.039999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.80200000000000005,"15min":0.80500000000000005},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.19900000000000001},"max":{"1min":12.388,"5min":12.388,"15min":21.757999999999999},"last":0.40600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5386670080,"data_stored":6718031378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8552787968,"data_stored":10653797163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3169402880,"data_stored":3938518297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:29:53.164 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:53.164 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:53.164 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:53.164 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:53.165 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:53.165 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:53.165 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:29:53.165 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:29:53.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:53.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:53.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:53.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:53.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:53.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:53.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:53.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:29:53.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:53.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:53.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:53.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:53.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:53.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:53.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:53.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:54.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:54.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:54.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:54.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:54.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:54.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:54.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:54.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:54.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:54.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:54.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:29:54.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:54.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:54.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:54.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:54.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:54.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:54.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:54.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:54.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:54.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:54.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:54.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:54.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:54.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:54.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:54.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:54.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:54.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:54.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:54.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:54.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:54.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:54.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:54.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:54.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:54.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:54.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:55.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:29:55.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:29:55.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:55.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:55.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:29:55.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:55.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:55.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:55.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:55.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:55.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:55.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:29:58.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:58.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:58.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:58.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:58.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:58.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:58.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:58.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:58.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:58.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:58.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:58.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:58.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:58.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:29:58.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:58.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:29:58.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:58.986+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:29:59.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:59.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:29:59.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:59.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:29:59.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:59.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:29:59.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:59.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:29:59.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:29:59.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:00.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:00.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:00.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:00.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:00.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:00.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:00.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:00.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:00.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:00.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:00.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:00.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:00.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:00.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:00.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:00.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:00.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:00.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:00.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:00.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:00.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:00.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:01.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:01.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:01.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:01.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:01.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:01.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:01.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:01.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:01.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:01.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:01.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:01.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:01.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:01.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:01.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:01.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:01.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:01.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:03.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:03.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:03.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:03.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:03.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:03.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:03.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:03.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:03.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:03.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:03.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:03.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:03.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:03.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:03.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:03.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:03.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:03.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:03.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:03.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:04.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:04.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:04.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:04.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:04.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:04.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:04.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:04.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:04.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:04.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:04.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:04.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:04.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:04.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:04.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:04.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:04.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:04.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:05.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:05.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:05.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:05.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:05.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:05.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:05.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:05.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:05.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:05.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:05.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:05.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:05.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:05.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:05.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:05.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:05.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:05.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:06.332 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:30:06.330+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:30:06.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:06.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:06.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:06.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:06.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:06.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:06.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:06.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:06.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:06.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:06.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:06.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:06.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:06.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:06.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:06.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:06.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:06.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:07.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:07.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:07.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:07.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:07.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:07.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:07.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:07.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:07.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:07.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:07.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:07.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:07.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:07.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:07.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:07.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:07.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:07.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:07.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:07.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:08.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:08.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:08.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:08.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:08.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:08.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:08.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:08.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:08.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:08.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:08.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:08.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:08.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:08.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:08.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:08.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:10.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:10.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:10.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:10.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:10.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:10.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:10.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:10.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:10.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:10.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:10.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:10.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:11.191 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:30:11.190+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:30:11.191 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:30:11.190+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:30:11.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:11.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:11.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:11.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:11.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:11.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:11.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:11.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:11.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:11.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:11.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:11.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:11.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:11.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:11.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:11.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:11.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:11.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:11.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:11.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:12.305 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:30:12.302+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:30:12.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:12.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:12.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:12.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:12.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:12.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:12.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:12.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:12.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:12.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:12.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:12.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:12.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:12.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:13.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:30:13.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:30:13.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:13.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:13.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:30:13.802 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:30:13.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:13.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:13.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:13.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:13.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:13.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:13.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:13.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:13.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:13.874 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2288,"stamp":"2023-09-23T08:30:12.372134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22998297931,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2148568,"num_read_kb":8440578,"num_write":2127066,"num_write_kb":8508635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80553,"ondisk_log_size":80553,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21975092,"kb_used_data":16746372,"kb_used_omap":1310,"kb_used_meta":5227361,"kb_avail":261140428,"statfs":{"total":289910292480,"available":267407798272,"internally_reserved":0,"allocated":17148284928,"data_stored":21344638723,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1342163,"internal_metadata":5352817965},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,37,10,15,9,10,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9224192,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4594,"num_read_kb":18372,"num_write":4430,"num_write_kb":17720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002854"},"pg_stats":[{"pgid":"2.7","version":"85'263469","reported_seq":518074,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:07.782492+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:30:07.782492+0000","last_peered":"2023-09-23T08:30:07.782492+0000","last_clean":"2023-09-23T08:30:07.782492+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:30:07.782492+0000","last_undegraded":"2023-09-23T08:30:07.782492+0000","last_fullsized":"2023-09-23T08:30:07.782492+0000","mapping_epoch":13,"log_start":"82'253410","ondisk_log_start":"82'253410","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2711232847,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":254195,"num_read_kb":998642,"num_write":250699,"num_write_kb":1002700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"85'290492","reported_seq":571521,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:07.784741+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:30:07.784741+0000","last_peered":"2023-09-23T08:30:07.784741+0000","last_clean":"2023-09-23T08:30:07.784741+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:30:07.784741+0000","last_undegraded":"2023-09-23T08:30:07.784741+0000","last_fullsized":"2023-09-23T08:30:07.784741+0000","mapping_epoch":13,"log_start":"82'280407","ondisk_log_start":"82'280407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3026653503,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":281389,"num_read_kb":1101414,"num_write":277760,"num_write_kb":1110809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"85'274798","reported_seq":539175,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:07.792259+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:30:07.792259+0000","last_peered":"2023-09-23T08:30:07.792259+0000","last_clean":"2023-09-23T08:30:07.792259+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:30:07.792259+0000","last_undegraded":"2023-09-23T08:30:07.792259+0000","last_fullsized":"2023-09-23T08:30:07.792259+0000","mapping_epoch":13,"log_start":"82'264709","ondisk_log_start":"82'264709","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2820469036,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":263953,"num_read_kb":1036913,"num_write":262049,"num_write_kb":1048109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"85'279537","reported_seq":559491,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:07.791000+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:30:07.791000+0000","last_peered":"2023-09-23T08:30:07.791000+0000","last_clean":"2023-09-23T08:30:07.791000+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:30:07.791000+0000","last_undegraded":"2023-09-23T08:30:07.791000+0000","last_fullsized":"2023-09-23T08:30:07.791000+0000","mapping_epoch":13,"log_start":"82'269507","ondisk_log_start":"82'269507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3017359642,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":280594,"num_read_kb":1108323,"num_write":278749,"num_write_kb":1114909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"85'273138","reported_seq":545070,"reported_epoch":85,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:30:10.328759+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:30:10.328759+0000","last_peered":"2023-09-23T08:30:10.328759+0000","last_clean":"2023-09-23T08:30:10.328759+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:30:10.328759+0000","last_undegraded":"2023-09-23T08:30:10.328759+0000","last_fullsized":"2023-09-23T08:30:10.328759+0000","mapping_epoch":13,"log_start":"82'263109","ondisk_log_start":"82'263109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1190,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 453s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2911334718,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":271769,"num_read_kb":1067947,"num_write":269815,"num_write_kb":1079110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"85'282181","reported_seq":561045,"reported_epoch":85,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:30:12.022992+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:30:12.022992+0000","last_peered":"2023-09-23T08:30:12.022992+0000","last_clean":"2023-09-23T08:30:12.022992+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:30:12.022992+0000","last_undegraded":"2023-09-23T08:30:12.022992+0000","last_fullsized":"2023-09-23T08:30:12.022992+0000","mapping_epoch":13,"log_start":"82'272111","ondisk_log_start":"82'272111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":139,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 71s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":2999116246,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":278477,"num_read_kb":1093356,"num_write":276364,"num_write_kb":1105336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"85'258551","reported_seq":514037,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:12.037360+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:30:12.037360+0000","last_peered":"2023-09-23T08:30:12.037360+0000","last_clean":"2023-09-23T08:30:12.037360+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:30:12.037360+0000","last_undegraded":"2023-09-23T08:30:12.037360+0000","last_fullsized":"2023-09-23T08:30:12.037360+0000","mapping_epoch":13,"log_start":"82'248508","ondisk_log_start":"82'248508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2720317741,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":254829,"num_read_kb":1000553,"num_write":252069,"num_write_kb":1008189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"85'272854","reported_seq":536602,"reported_epoch":85,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:30:07.791371+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:30:07.791371+0000","last_peered":"2023-09-23T08:30:07.791371+0000","last_clean":"2023-09-23T08:30:07.791371+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:30:07.791371+0000","last_undegraded":"2023-09-23T08:30:07.791371+0000","last_fullsized":"2023-09-23T08:30:07.791371+0000","mapping_epoch":13,"log_start":"82'262805","ondisk_log_start":"82'262805","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":995,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 446s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2791223830,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":263256,"num_read_kb":1033339,"num_write":259424,"num_write_kb":1037579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":257,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-23T08:28:42.046855+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:28:42.046855+0000","last_peered":"2023-09-23T08:28:42.046855+0000","last_clean":"2023-09-23T08:28:42.046855+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:28:42.046855+0000","last_undegraded":"2023-09-23T08:28:42.046855+0000","last_fullsized":"2023-09-23T08:28:42.046855+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":22997707563,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2148462,"num_read_kb":8440487,"num_write":2126929,"num_write_kb":8506741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17146728448,"data_stored":21343188566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80454,"ondisk_log_size":80454,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739252,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5036272,"kb_used_data":3102556,"kb_used_omap":219,"kb_used_meta":1933476,"kb_avail":89335568,"statfs":{"total":96636764160,"available":91479621632,"internally_reserved":0,"allocated":3177017344,"data_stored":3944866792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":1979880269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,5,4,6,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:30:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.63400000000000001,"15min":0.72599999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":4.0179999999999998,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72099999999999997,"15min":1.0089999999999999},"min":{"1min":0.24099999999999999,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":5.9029999999999996,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.30399999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:30:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.99299999999999999},"min":{"1min":0.26600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":4.0620000000000003,"5min":5.931,"15min":25.550000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":1.1060000000000001,"15min":1.2130000000000001},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.182},"max":{"1min":5.6109999999999998,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.51300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739240,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10434876,"kb_used_data":8371244,"kb_used_omap":676,"kb_used_meta":2062939,"kb_avail":83936964,"statfs":{"total":96636764160,"available":85951451136,"internally_reserved":0,"allocated":8572153856,"data_stored":10670767130,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":693144,"internal_metadata":2112449640},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,33,7,7,4,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:29:59 2023","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":1.0880000000000001,"15min":0.89900000000000002},"min":{"1min":0.20200000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":21.216000000000001,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":2.3250000000000002,"5min":1.5149999999999999,"15min":1.391},"min":{"1min":0.214,"5min":0.192,"15min":0.18099999999999999},"max":{"1min":21.388999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":2.629}]},{"osd":2,"last update":"Sat Sep 23 08:29:59 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1100000000000001,"15min":0.94499999999999995},"min":{"1min":0.23400000000000001,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":9.0980000000000008,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.264,"15min":0.99299999999999999},"min":{"1min":0.26100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":11.98,"5min":26.151,"15min":26.151},"last":0.30099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739247,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6503944,"kb_used_data":5272572,"kb_used_omap":414,"kb_used_meta":1230945,"kb_avail":87867896,"statfs":{"total":96636764160,"available":89976725504,"internally_reserved":0,"allocated":5399113728,"data_stored":6729004801,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":424584,"internal_metadata":1260488056},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,2,3,1,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:30:02 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":0.80800000000000005,"15min":1.306},"min":{"1min":0.26300000000000001,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":5.6950000000000003,"5min":5.6950000000000003,"15min":21.207000000000001},"last":0.309},{"interface":"front","average":{"1min":1.2569999999999999,"5min":0.95099999999999996,"15min":0.96399999999999997},"min":{"1min":0.30299999999999999,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":5.742,"5min":5.742,"15min":20.436},"last":0.37}]},{"osd":2,"last update":"Sat Sep 23 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":0.91600000000000004,"15min":0.78700000000000003},"min":{"1min":0.23200000000000001,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":12.529,"5min":12.529,"15min":15.039999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.80200000000000005,"15min":0.80500000000000005},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.19900000000000001},"max":{"1min":12.388,"5min":12.388,"15min":21.757999999999999},"last":0.34599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5398421504,"data_stored":6728185362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8571875328,"data_stored":10670316331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3176431616,"data_stored":3944686873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:30:13.875 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:13.876 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:13.876 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:13.876 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:13.876 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:13.876 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:13.877 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:13.877 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:30:14.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:14.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:14.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:14.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:14.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:14.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:14.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:14.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:14.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:14.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:14.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:14.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:14.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:14.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:14.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:14.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:14.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:14.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:16.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:16.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:16.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:16.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:16.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:16.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:16.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:16.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:16.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:16.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:16.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:16.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:16.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:16.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:16.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:16.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:16.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:16.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:17.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:17.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:17.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:17.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:17.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:17.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:17.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:17.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:17.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:17.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:17.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:17.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:17.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:17.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:18.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:18.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:18.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:18.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:18.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:18.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:18.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:18.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:18.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:18.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:19.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:19.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:18.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:19.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:19.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:19.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:19.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:19.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:19.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:19.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:19.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:19.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:19.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:30:19.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:19.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:19.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:19.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:19.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:20.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:20.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:20.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:20.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:20.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:20.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:20.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:20.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:20.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:20.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:20.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:20.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:20.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:20.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:20.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:20.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:20.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:20.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:20.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:20.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:21.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:21.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:21.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:21.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:21.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:21.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:21.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:21.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:21.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:21.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:21.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:21.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:21.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:21.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:21.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:21.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:21.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:21.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:21.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:21.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:22.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:22.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:22.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:22.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:22.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:22.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:22.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:22.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:22.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:22.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:22.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:22.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:22.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:22.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:22.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:22.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:22.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:22.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:23.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:30:23.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:23.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:23.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:23.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:23.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:23.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:23.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:23.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:23.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:23.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:23.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:23.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:25.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:25.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:25.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:25.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:25.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:25.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:25.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:25.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:25.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:25.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:25.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:25.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:25.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:25.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:25.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:25.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:25.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:25.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:26.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:26.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:26.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:26.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:26.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:26.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:26.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:26.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:27.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:27.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:27.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:27.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:27.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:27.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:27.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:27.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:27.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:27.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:27.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:27.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:27.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:27.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:27.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:27.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:27.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:27.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:27.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:27.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:27.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:27.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:27.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:27.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:27.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:27.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:27.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:27.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:27.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:27.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:31.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:31.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:31.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:31.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:31.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:31.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:31.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:31.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:31.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:31.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:31.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:31.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:31.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:31.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:31.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:31.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:31.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:31.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:31.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:33.878 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:30:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:30:34.755 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:30:34.833 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2299,"stamp":"2023-09-23T08:30:34.379777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23017848139,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2158644,"num_read_kb":8480870,"num_write":2136361,"num_write_kb":8545815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80591,"ondisk_log_size":80591,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21783940,"kb_used_data":16788908,"kb_used_omap":1310,"kb_used_meta":4993697,"kb_avail":261331580,"statfs":{"total":289910292480,"available":267603537920,"internally_reserved":0,"allocated":17191841792,"data_stored":21382444803,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1342163,"internal_metadata":5113546029},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8,15,8,11,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11079680,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5616,"num_read_kb":22456,"num_write":5254,"num_write_kb":21016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001964"},"pg_stats":[{"pgid":"2.7","version":"85'264703","reported_seq":520645,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:33.491746+0000","last_change":"2023-09-23T07:31:06.907420+0000","last_active":"2023-09-23T08:30:33.491746+0000","last_peered":"2023-09-23T08:30:33.491746+0000","last_clean":"2023-09-23T08:30:33.491746+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:30:33.491746+0000","last_undegraded":"2023-09-23T08:30:33.491746+0000","last_fullsized":"2023-09-23T08:30:33.491746+0000","mapping_epoch":13,"log_start":"82'254610","ondisk_log_start":"82'254610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2713682255,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":255518,"num_read_kb":1003930,"num_write":251858,"num_write_kb":1007336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"85'291937","reported_seq":574377,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:33.482950+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:30:33.482950+0000","last_peered":"2023-09-23T08:30:33.482950+0000","last_clean":"2023-09-23T08:30:33.482950+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:30:33.482950+0000","last_undegraded":"2023-09-23T08:30:33.482950+0000","last_fullsized":"2023-09-23T08:30:33.482950+0000","mapping_epoch":13,"log_start":"83'281907","ondisk_log_start":"83'281907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3029557567,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":282785,"num_read_kb":1106998,"num_write":279130,"num_write_kb":1116289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"85'276093","reported_seq":541822,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:33.489663+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:30:33.489663+0000","last_peered":"2023-09-23T08:30:33.489663+0000","last_clean":"2023-09-23T08:30:33.489663+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:30:33.489663+0000","last_undegraded":"2023-09-23T08:30:33.489663+0000","last_fullsized":"2023-09-23T08:30:33.489663+0000","mapping_epoch":13,"log_start":"83'266009","ondisk_log_start":"83'266009","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2822910252,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":265291,"num_read_kb":1042265,"num_write":263269,"num_write_kb":1052989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"85'280877","reported_seq":562234,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:33.492169+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:30:33.492169+0000","last_peered":"2023-09-23T08:30:33.492169+0000","last_clean":"2023-09-23T08:30:33.492169+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:30:33.492169+0000","last_undegraded":"2023-09-23T08:30:33.492169+0000","last_fullsized":"2023-09-23T08:30:33.492169+0000","mapping_epoch":13,"log_start":"83'270807","ondisk_log_start":"83'270807","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3020120346,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":281998,"num_read_kb":1113939,"num_write":280089,"num_write_kb":1120269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"85'274211","reported_seq":547285,"reported_epoch":85,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:30:30.407362+0000","last_change":"2023-09-23T08:22:37.059135+0000","last_active":"2023-09-23T08:30:30.407362+0000","last_peered":"2023-09-23T08:30:30.407362+0000","last_clean":"2023-09-23T08:30:30.407362+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:30:30.407362+0000","last_undegraded":"2023-09-23T08:30:30.407362+0000","last_fullsized":"2023-09-23T08:30:30.407362+0000","mapping_epoch":13,"log_start":"83'264209","ondisk_log_start":"83'264209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1236,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 473s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2913583422,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":272889,"num_read_kb":1072423,"num_write":270850,"num_write_kb":1083250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"85'283246","reported_seq":563270,"reported_epoch":85,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:30:32.188281+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:30:32.188281+0000","last_peered":"2023-09-23T08:30:32.188281+0000","last_clean":"2023-09-23T08:30:32.188281+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:30:32.188281+0000","last_undegraded":"2023-09-23T08:30:32.188281+0000","last_fullsized":"2023-09-23T08:30:32.188281+0000","mapping_epoch":13,"log_start":"83'273211","ondisk_log_start":"83'273211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":191,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 91s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3001319894,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":279609,"num_read_kb":1097880,"num_write":277375,"num_write_kb":1109380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"85'259500","reported_seq":516031,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:32.165553+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:30:32.165553+0000","last_peered":"2023-09-23T08:30:32.165553+0000","last_clean":"2023-09-23T08:30:32.165553+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:30:32.165553+0000","last_undegraded":"2023-09-23T08:30:32.165553+0000","last_fullsized":"2023-09-23T08:30:32.165553+0000","mapping_epoch":13,"log_start":"82'249408","ondisk_log_start":"82'249408","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2722378029,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":255864,"num_read_kb":1004693,"num_write":252997,"num_write_kb":1011901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"85'274192","reported_seq":539292,"reported_epoch":85,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:30:33.482367+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:30:33.482367+0000","last_peered":"2023-09-23T08:30:33.482367+0000","last_clean":"2023-09-23T08:30:33.482367+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:30:33.482367+0000","last_undegraded":"2023-09-23T08:30:33.482367+0000","last_fullsized":"2023-09-23T08:30:33.482367+0000","mapping_epoch":13,"log_start":"83'264106","ondisk_log_start":"83'264106","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1051,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 472s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2793706006,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":264584,"num_read_kb":1038651,"num_write":260656,"num_write_kb":1042507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":258,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:29:52.136026+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:29:52.136026+0000","last_peered":"2023-09-23T08:29:52.136026+0000","last_clean":"2023-09-23T08:29:52.136026+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:29:52.136026+0000","last_undegraded":"2023-09-23T08:29:52.136026+0000","last_fullsized":"2023-09-23T08:29:52.136026+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23017257771,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2158538,"num_read_kb":8480779,"num_write":2136224,"num_write_kb":8543921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17190318080,"data_stored":21381051990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80492,"ondisk_log_size":80492,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739256,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080992,"kb_used_data":3109528,"kb_used_omap":219,"kb_used_meta":1971236,"kb_avail":89290848,"statfs":{"total":96636764160,"available":91433828352,"internally_reserved":0,"allocated":3184156672,"data_stored":3951055848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224435,"internal_metadata":2018546509},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,4,3,5,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:30:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.63400000000000001,"15min":0.72599999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":4.0179999999999998,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72099999999999997,"15min":1.0089999999999999},"min":{"1min":0.24099999999999999,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":5.9029999999999996,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.29699999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:30:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.99299999999999999},"min":{"1min":0.26600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":4.0620000000000003,"5min":5.931,"15min":25.550000000000001},"last":0.372},{"interface":"front","average":{"1min":0.67800000000000005,"5min":1.1060000000000001,"15min":1.2130000000000001},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.182},"max":{"1min":5.6109999999999998,"5min":14.311999999999999,"15min":14.311999999999999},"last":2.2999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739245,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10106628,"kb_used_data":8395196,"kb_used_omap":676,"kb_used_meta":1710747,"kb_avail":84265212,"statfs":{"total":96636764160,"available":86287577088,"internally_reserved":0,"allocated":8596680704,"data_stored":10692025370,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":693144,"internal_metadata":1751805032},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,7,2,4,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:29:59 2023","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":1.0880000000000001,"15min":0.89900000000000002},"min":{"1min":0.20200000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":21.216000000000001,"5min":21.216000000000001,"15min":21.216000000000001},"last":3.012},{"interface":"front","average":{"1min":2.3250000000000002,"5min":1.5149999999999999,"15min":1.391},"min":{"1min":0.214,"5min":0.192,"15min":0.18099999999999999},"max":{"1min":21.388999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.372}]},{"osd":2,"last update":"Sat Sep 23 08:29:59 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1100000000000001,"15min":0.94499999999999995},"min":{"1min":0.23400000000000001,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":9.0980000000000008,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.264,"15min":0.99299999999999999},"min":{"1min":0.26100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":11.98,"5min":26.151,"15min":26.151},"last":0.48999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739251,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6596320,"kb_used_data":5284184,"kb_used_omap":414,"kb_used_meta":1311713,"kb_avail":87775520,"statfs":{"total":96636764160,"available":89882132480,"internally_reserved":0,"allocated":5411004416,"data_stored":6739363585,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":424584,"internal_metadata":1343194488},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,4,3,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:30:02 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":0.80800000000000005,"15min":1.306},"min":{"1min":0.26300000000000001,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":5.6950000000000003,"5min":5.6950000000000003,"15min":21.207000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":1.2569999999999999,"5min":0.95099999999999996,"15min":0.96399999999999997},"min":{"1min":0.30299999999999999,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":5.742,"5min":5.742,"15min":20.436},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":0.91600000000000004,"15min":0.78700000000000003},"min":{"1min":0.23200000000000001,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":12.529,"5min":12.529,"15min":15.039999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.80200000000000005,"15min":0.80500000000000005},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.19900000000000001},"max":{"1min":12.388,"5min":12.388,"15min":21.757999999999999},"last":0.307}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5410402304,"data_stored":6738638354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8596344832,"data_stored":10691537707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3183570944,"data_stored":3950875929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:30:34.835 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:34.835 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:34.835 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:34.835 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:34.835 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:34.836 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:34.836 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:34.836 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:30:37.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:37.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:37.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:37.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:37.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:37.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:37.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:37.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:37.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:37.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:37.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:37.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:37.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:37.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:37.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:37.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:37.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:37.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:43.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:43.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:43.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:43.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:43.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:43.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:43.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:43.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:43.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:43.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:43.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:43.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:43.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:43.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:43.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:43.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:43.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:43.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:43.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:43.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:45.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:45.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:45.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:45.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:45.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:45.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:45.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:45.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:45.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:45.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:45.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:45.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:45.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:45.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:45.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:45.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:45.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:45.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:46.043 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:30:46.037+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:30:46.043 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:30:46.041+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:30:46.043 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:30:46.041+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:30:46.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:46.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:46.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:46.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:46.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:46.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:46.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:46.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:46.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:46.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:46.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:46.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:47.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:47.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:47.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:47.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:47.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:47.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:47.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:47.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:47.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:47.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:47.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:47.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:47.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:47.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:47.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:47.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:47.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:47.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:50.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:50.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:50.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:50.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:50.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:50.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:50.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:50.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:50.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:50.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:50.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:50.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:50.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:50.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:50.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:50.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:50.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:50.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:51.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:51.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:51.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:51.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:51.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:51.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:51.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:51.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:51.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:51.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:51.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:51.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:51.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:51.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:51.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:51.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:51.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:51.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:51.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:51.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:51.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:51.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:52.436 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:30:52.433+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:30:52.436 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:30:52.433+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:30:53.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:53.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:53.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:53.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:53.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:53.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:53.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:53.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:53.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:53.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:53.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:53.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:53.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:53.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:53.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:53.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:53.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:53.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:53.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:53.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:54.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:54.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:54.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:54.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:54.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:54.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:54.837 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:30:55.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:55.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:30:55.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:55.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:55.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:55.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:55.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:55.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:55.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:55.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:55.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:30:55.792 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:30:55.836 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2309,"stamp":"2023-09-23T08:30:54.383026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23033961803,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2166792,"num_read_kb":8513458,"num_write":2144171,"num_write_kb":8577055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4332,"num_omap_keys":72,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80573,"ondisk_log_size":80573,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21512276,"kb_used_data":16825196,"kb_used_omap":1312,"kb_used_meta":4685727,"kb_avail":261603244,"statfs":{"total":289910292480,"available":267881721856,"internally_reserved":0,"allocated":17229000704,"data_stored":21414962947,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1343843,"internal_metadata":4798185117},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,3,10,13,19,13],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10174464,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5125,"num_read_kb":20496,"num_write":5027,"num_write_kb":20108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001830"},"pg_stats":[{"pgid":"2.7","version":"85'265649","reported_seq":522542,"reported_epoch":85,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:30:53.794468+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:30:53.794468+0000","last_peered":"2023-09-23T08:30:53.794468+0000","last_clean":"2023-09-23T08:30:53.794468+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:30:53.794468+0000","last_undegraded":"2023-09-23T08:30:53.794468+0000","last_fullsized":"2023-09-23T08:30:53.794468+0000","mapping_epoch":13,"log_start":"83'255610","ondisk_log_start":"83'255610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":4,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2715541839,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":256451,"num_read_kb":1007662,"num_write":252768,"num_write_kb":1010976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"85'292983","reported_seq":576505,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:53.815122+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:30:53.815122+0000","last_peered":"2023-09-23T08:30:53.815122+0000","last_clean":"2023-09-23T08:30:53.815122+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:30:53.815122+0000","last_undegraded":"2023-09-23T08:30:53.815122+0000","last_fullsized":"2023-09-23T08:30:53.815122+0000","mapping_epoch":13,"log_start":"83'282907","ondisk_log_start":"83'282907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3031695679,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":283857,"num_read_kb":1111286,"num_write":280143,"num_write_kb":1120341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"85'277088","reported_seq":543802,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:53.796651+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:30:53.796651+0000","last_peered":"2023-09-23T08:30:53.796651+0000","last_clean":"2023-09-23T08:30:53.796651+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:30:53.796651+0000","last_undegraded":"2023-09-23T08:30:53.796651+0000","last_fullsized":"2023-09-23T08:30:53.796651+0000","mapping_epoch":13,"log_start":"83'267009","ondisk_log_start":"83'267009","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2824876332,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":266263,"num_read_kb":1046153,"num_write":264231,"num_write_kb":1056837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"85'281887","reported_seq":564319,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:53.773782+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:30:53.773782+0000","last_peered":"2023-09-23T08:30:53.773782+0000","last_clean":"2023-09-23T08:30:53.773782+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:30:53.773782+0000","last_undegraded":"2023-09-23T08:30:53.773782+0000","last_fullsized":"2023-09-23T08:30:53.773782+0000","mapping_epoch":13,"log_start":"83'271807","ondisk_log_start":"83'271807","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3022336282,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":283072,"num_read_kb":1118231,"num_write":281099,"num_write_kb":1124309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"85'275263","reported_seq":549456,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:50.781781+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:30:50.781781+0000","last_peered":"2023-09-23T08:30:50.781781+0000","last_clean":"2023-09-23T08:30:50.781781+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:30:50.781781+0000","last_undegraded":"2023-09-23T08:30:50.781781+0000","last_fullsized":"2023-09-23T08:30:50.781781+0000","mapping_epoch":13,"log_start":"83'265209","ondisk_log_start":"83'265209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2915762494,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":273988,"num_read_kb":1076819,"num_write":271873,"num_write_kb":1087342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"85'284297","reported_seq":565426,"reported_epoch":85,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:30:52.408226+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:30:52.408226+0000","last_peered":"2023-09-23T08:30:52.408226+0000","last_clean":"2023-09-23T08:30:52.408226+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:30:52.408226+0000","last_undegraded":"2023-09-23T08:30:52.408226+0000","last_fullsized":"2023-09-23T08:30:52.408226+0000","mapping_epoch":13,"log_start":"83'274211","ondisk_log_start":"83'274211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":252,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 111s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3003347414,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":280692,"num_read_kb":1102212,"num_write":278370,"num_write_kb":1113360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"85'260456","reported_seq":517945,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:52.391595+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:30:52.391595+0000","last_peered":"2023-09-23T08:30:52.391595+0000","last_clean":"2023-09-23T08:30:52.391595+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:30:52.391595+0000","last_undegraded":"2023-09-23T08:30:52.391595+0000","last_fullsized":"2023-09-23T08:30:52.391595+0000","mapping_epoch":13,"log_start":"83'250408","ondisk_log_start":"83'250408","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2724245805,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":256808,"num_read_kb":1008469,"num_write":253938,"num_write_kb":1015665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"85'275218","reported_seq":541307,"reported_epoch":85,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:30:53.804828+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:30:53.804828+0000","last_peered":"2023-09-23T08:30:53.804828+0000","last_clean":"2023-09-23T08:30:53.804828+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:30:53.804828+0000","last_undegraded":"2023-09-23T08:30:53.804828+0000","last_fullsized":"2023-09-23T08:30:53.804828+0000","mapping_epoch":13,"log_start":"83'265206","ondisk_log_start":"83'265206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1113,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 492s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2795565590,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":265555,"num_read_kb":1042535,"num_write":261612,"num_write_kb":1046331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":258,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:29:52.136026+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:29:52.136026+0000","last_peered":"2023-09-23T08:29:52.136026+0000","last_clean":"2023-09-23T08:29:52.136026+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:29:52.136026+0000","last_undegraded":"2023-09-23T08:29:52.136026+0000","last_fullsized":"2023-09-23T08:29:52.136026+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23033371435,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2166686,"num_read_kb":8513367,"num_write":2144034,"num_write_kb":8575161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4332,"num_omap_keys":72,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17227874304,"data_stored":21413914198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80474,"ondisk_log_size":80474,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4576928,"kb_used_data":3116120,"kb_used_omap":220,"kb_used_meta":1460579,"kb_avail":89794912,"statfs":{"total":96636764160,"available":91949989888,"internally_reserved":0,"allocated":3190906880,"data_stored":3957031912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1495633085},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,1,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:30:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.63400000000000001,"15min":0.72599999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":4.0179999999999998,"5min":10.922000000000001,"15min":10.922000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72099999999999997,"15min":1.0089999999999999},"min":{"1min":0.24099999999999999,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":5.9029999999999996,"5min":10.954000000000001,"15min":25.483000000000001},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Sep 23 08:30:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.99299999999999999},"min":{"1min":0.26600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":4.0620000000000003,"5min":5.931,"15min":25.550000000000001},"last":0.37},{"interface":"front","average":{"1min":0.67800000000000005,"5min":1.1060000000000001,"15min":1.2130000000000001},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.182},"max":{"1min":5.6109999999999998,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.38200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739249,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10255080,"kb_used_data":8413136,"kb_used_omap":676,"kb_used_meta":1841243,"kb_avail":84116760,"statfs":{"total":96636764160,"available":86135562240,"internally_reserved":0,"allocated":8615051264,"data_stored":10708143130,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":693144,"internal_metadata":1885432936},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,0,8,9,6,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:29:59 2023","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":1.0880000000000001,"15min":0.89900000000000002},"min":{"1min":0.20200000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":21.216000000000001,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":2.3250000000000002,"5min":1.5149999999999999,"15min":1.391},"min":{"1min":0.214,"5min":0.192,"15min":0.18099999999999999},"max":{"1min":21.388999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:29:59 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1100000000000001,"15min":0.94499999999999995},"min":{"1min":0.23400000000000001,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":9.0980000000000008,"5min":26.117000000000001,"15min":26.117000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.264,"15min":0.99299999999999999},"min":{"1min":0.26100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":11.98,"5min":26.151,"15min":26.151},"last":0.441}]}]},{"osd":0,"up_from":8,"seq":34359739255,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6680268,"kb_used_data":5295940,"kb_used_omap":414,"kb_used_meta":1383905,"kb_avail":87691572,"statfs":{"total":96636764160,"available":89796169728,"internally_reserved":0,"allocated":5423042560,"data_stored":6749787905,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":424584,"internal_metadata":1417119096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,3,9,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:30:02 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":0.80800000000000005,"15min":1.306},"min":{"1min":0.26300000000000001,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":5.6950000000000003,"5min":5.6950000000000003,"15min":21.207000000000001},"last":0.751},{"interface":"front","average":{"1min":1.2569999999999999,"5min":0.95099999999999996,"15min":0.96399999999999997},"min":{"1min":0.30299999999999999,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":5.742,"5min":5.742,"15min":20.436},"last":0.79000000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:30:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.89200000000000002,"15min":0.79700000000000004},"min":{"1min":0.193,"5min":0.193,"15min":0.186},"max":{"1min":4.04,"5min":12.529,"15min":15.039999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.68600000000000005,"15min":0.78400000000000003},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.218},"max":{"1min":0.96299999999999997,"5min":12.388,"15min":21.757999999999999},"last":0.309}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5422456832,"data_stored":6749062674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8615059456,"data_stored":10707970859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3190358016,"data_stored":3956880665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:30:55.839 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:55.839 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:55.839 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:55.839 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:55.840 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:55.840 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:30:55.840 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:30:55.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:55.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:55.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:55.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:55.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:55.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:56.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:56.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:56.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:56.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:56.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:56.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:30:58.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:58.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:30:58.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:58.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:30:58.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:58.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:30:58.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:58.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:30:58.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:58.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:30:58.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:58.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:30:58.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:58.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:30:58.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:58.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:30:58.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:58.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:30:58.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:30:58.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:00.959 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:31:00.957+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:31:00.961 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:31:00.957+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:31:00.962 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:31:00.957+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:31:03.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:03.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:03.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:03.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:03.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:03.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:03.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:03.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:03.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:03.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:03.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:03.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:03.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:03.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:03.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:03.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:03.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:04.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:04.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:04.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:04.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:04.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:04.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:04.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:04.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:04.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:04.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:04.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:04.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:04.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:04.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:04.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:04.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:04.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:05.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:05.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:05.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:05.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:05.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:05.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:05.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:05.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:05.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:05.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:05.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:05.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:05.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:05.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:05.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:05.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:07.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:07.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:07.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:07.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:07.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:07.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:07.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:07.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:07.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:07.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:07.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:07.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:07.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:07.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:07.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:07.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:07.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:07.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:07.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:07.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:08.159 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:31:08.157+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:31:08.160 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:31:08.157+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:31:09.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:09.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:09.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:09.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:09.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:09.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:09.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:09.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:09.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:09.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:09.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:31:09.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:09.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:09.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:09.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:12.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:12.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:12.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:12.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:12.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:12.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:13.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:13.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:13.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:13.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:13.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:13.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:13.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:13.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:13.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:13.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:13.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:13.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:13.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:13.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:13.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:13.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:13.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:13.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:15.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:15.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:15.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:15.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:15.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:15.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:15.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:15.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:15.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:15.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:15.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:15.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:15.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:15.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:15.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:15.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:15.841 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:31:15.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:15.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:15.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:15.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:15.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:15.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:16.583 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:31:16.584 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:31:16.619 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2321,"stamp":"2023-09-23T08:31:16.403187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23050628427,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2175080,"num_read_kb":8546598,"num_write":2152186,"num_write_kb":8609115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4332,"num_omap_keys":72,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80479,"ondisk_log_size":80479,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21735852,"kb_used_data":16864896,"kb_used_omap":1312,"kb_used_meta":4869599,"kb_avail":261379668,"statfs":{"total":289910292480,"available":267652780032,"internally_reserved":0,"allocated":17269653504,"data_stored":21450546490,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1343843,"internal_metadata":4986470045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,1,6,4,9,16,12,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8384512,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3985,"num_read_kb":15928,"num_write":3999,"num_write_kb":15996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.011360"},"pg_stats":[{"pgid":"2.7","version":"86'266647","reported_seq":524516,"reported_epoch":86,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:31:14.227630+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:31:14.227630+0000","last_peered":"2023-09-23T08:31:14.227630+0000","last_clean":"2023-09-23T08:31:14.227630+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:31:14.227630+0000","last_undegraded":"2023-09-23T08:31:14.227630+0000","last_fullsized":"2023-09-23T08:31:14.227630+0000","mapping_epoch":13,"log_start":"83'256610","ondisk_log_start":"83'256610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":42,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 26s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2717446479,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":257407,"num_read_kb":1011486,"num_write":253699,"num_write_kb":1014700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"86'294056","reported_seq":578639,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:14.224960+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:31:14.224960+0000","last_peered":"2023-09-23T08:31:14.224960+0000","last_clean":"2023-09-23T08:31:14.224960+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:31:14.224960+0000","last_undegraded":"2023-09-23T08:31:14.224960+0000","last_fullsized":"2023-09-23T08:31:14.224960+0000","mapping_epoch":13,"log_start":"83'284007","ondisk_log_start":"83'284007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3033977151,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":284904,"num_read_kb":1115470,"num_write":281176,"num_write_kb":1124473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"86'278132","reported_seq":545902,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:14.202570+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:31:14.202570+0000","last_peered":"2023-09-23T08:31:14.202570+0000","last_clean":"2023-09-23T08:31:14.202570+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:31:14.202570+0000","last_undegraded":"2023-09-23T08:31:14.202570+0000","last_fullsized":"2023-09-23T08:31:14.202570+0000","mapping_epoch":13,"log_start":"83'268109","ondisk_log_start":"83'268109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2826948908,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":267310,"num_read_kb":1050341,"num_write":265231,"num_write_kb":1060837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"86'282894","reported_seq":566329,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:14.220910+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:31:14.220910+0000","last_peered":"2023-09-23T08:31:14.220910+0000","last_clean":"2023-09-23T08:31:14.220910+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:31:14.220910+0000","last_undegraded":"2023-09-23T08:31:14.220910+0000","last_fullsized":"2023-09-23T08:31:14.220910+0000","mapping_epoch":13,"log_start":"83'272807","ondisk_log_start":"83'272807","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3024335130,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":284076,"num_read_kb":1122247,"num_write":282106,"num_write_kb":1128337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"86'276484","reported_seq":551947,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:15.980529+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:31:15.980529+0000","last_peered":"2023-09-23T08:31:15.980529+0000","last_clean":"2023-09-23T08:31:15.980529+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:31:15.980529+0000","last_undegraded":"2023-09-23T08:31:15.980529+0000","last_fullsized":"2023-09-23T08:31:15.980529+0000","mapping_epoch":13,"log_start":"83'266409","ondisk_log_start":"83'266409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2918322494,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":275253,"num_read_kb":1081875,"num_write":273086,"num_write_kb":1092194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"86'285317","reported_seq":567539,"reported_epoch":86,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:31:12.584649+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:31:12.584649+0000","last_peered":"2023-09-23T08:31:12.584649+0000","last_clean":"2023-09-23T08:31:12.584649+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:31:12.584649+0000","last_undegraded":"2023-09-23T08:31:12.584649+0000","last_fullsized":"2023-09-23T08:31:12.584649+0000","mapping_epoch":13,"log_start":"83'275311","ondisk_log_start":"83'275311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":290,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 132s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3005354454,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":281768,"num_read_kb":1106516,"num_write":279341,"num_write_kb":1117244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"86'261354","reported_seq":519792,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:12.471133+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:31:12.471133+0000","last_peered":"2023-09-23T08:31:12.471133+0000","last_clean":"2023-09-23T08:31:12.471133+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:31:12.471133+0000","last_undegraded":"2023-09-23T08:31:12.471133+0000","last_fullsized":"2023-09-23T08:31:12.471133+0000","mapping_epoch":13,"log_start":"83'251308","ondisk_log_start":"83'251308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2726043949,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":257743,"num_read_kb":1012209,"num_write":254812,"num_write_kb":1019161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"86'276263","reported_seq":543331,"reported_epoch":86,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:31:14.224120+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:31:14.224120+0000","last_peered":"2023-09-23T08:31:14.224120+0000","last_clean":"2023-09-23T08:31:14.224120+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:31:14.224120+0000","last_undegraded":"2023-09-23T08:31:14.224120+0000","last_fullsized":"2023-09-23T08:31:14.224120+0000","mapping_epoch":13,"log_start":"83'266206","ondisk_log_start":"83'266206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1145,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 513s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2797609494,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":266513,"num_read_kb":1046363,"num_write":262598,"num_write_kb":1050275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":259,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:23.189835+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:30:23.189835+0000","last_peered":"2023-09-23T08:30:23.189835+0000","last_clean":"2023-09-23T08:30:23.189835+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:30:23.189835+0000","last_undegraded":"2023-09-23T08:30:23.189835+0000","last_fullsized":"2023-09-23T08:30:23.189835+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23050038059,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2174974,"num_read_kb":8546507,"num_write":2152049,"num_write_kb":8607221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4332,"num_omap_keys":72,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17268342784,"data_stored":21449348694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80380,"ondisk_log_size":80380,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739264,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4622336,"kb_used_data":3122676,"kb_used_omap":220,"kb_used_meta":1499427,"kb_avail":89749504,"statfs":{"total":96636764160,"available":91903492096,"internally_reserved":0,"allocated":3197620224,"data_stored":3962962085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1535413437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,2,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:31:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.57499999999999996,"15min":0.746},"min":{"1min":0.186,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":6.1630000000000003,"5min":6.1630000000000003,"15min":10.922000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.626,"15min":0.88100000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":6.2009999999999996,"5min":6.2009999999999996,"15min":10.954000000000001},"last":1.6559999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:31:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.85299999999999998,"15min":0.92000000000000004},"min":{"1min":0.24099999999999999,"5min":0.215,"15min":0.215},"max":{"1min":4.0039999999999996,"5min":5.2489999999999997,"15min":11.65},"last":0.29799999999999999},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.1679999999999999,"15min":1.2250000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.182},"max":{"1min":6.1849999999999996,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.20699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739253,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10337108,"kb_used_data":8432064,"kb_used_omap":676,"kb_used_meta":1904347,"kb_avail":84034732,"statfs":{"total":96636764160,"available":86051565568,"internally_reserved":0,"allocated":8634433536,"data_stored":10725087447,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":693144,"internal_metadata":1950051432},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,4,3,6,11,12,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":1.0609999999999999,"15min":0.88700000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":3.012,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.454,"15min":1.4039999999999999},"min":{"1min":0.22,"5min":0.193,"15min":0.18099999999999999},"max":{"1min":9.7949999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.79400000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.85599999999999998,"15min":0.95699999999999996},"min":{"1min":0.249,"5min":0.23000000000000001,"15min":0.19700000000000001},"max":{"1min":4.9119999999999999,"5min":9.0980000000000008,"15min":26.117000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.95799999999999996,"15min":0.93799999999999994},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":0.70499999999999996,"5min":11.98,"15min":26.151},"last":0.26500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739260,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6776408,"kb_used_data":5310156,"kb_used_omap":414,"kb_used_meta":1465825,"kb_avail":87595432,"statfs":{"total":96636764160,"available":89697722368,"internally_reserved":0,"allocated":5437599744,"data_stored":6762496958,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":424584,"internal_metadata":1501005176},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,1,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:31:05 2023","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.0289999999999999,"15min":1.2490000000000001},"min":{"1min":0.223,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":7.2510000000000003,"5min":7.2510000000000003,"15min":21.207000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":2.2210000000000001,"5min":1.2290000000000001,"15min":0.98199999999999998},"min":{"1min":0.25600000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":7.2949999999999999,"5min":7.2949999999999999,"15min":20.436},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:30:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.89200000000000002,"15min":0.79700000000000004},"min":{"1min":0.193,"5min":0.193,"15min":0.186},"max":{"1min":4.04,"5min":12.529,"15min":15.039999999999999},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.68600000000000005,"15min":0.78400000000000003},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.218},"max":{"1min":0.96299999999999997,"5min":12.388,"15min":21.757999999999999},"last":0.36799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5437227008,"data_stored":6761977362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8633962496,"data_stored":10724469547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3197153280,"data_stored":3962901785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:31:16.620 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:16.621 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:16.621 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:16.621 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:16.622 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:16.622 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:16.622 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:31:18.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:18.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:18.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:18.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:18.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:18.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:18.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:18.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:18.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:18.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:18.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:18.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:18.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:18.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:18.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:18.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:18.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:18.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:18.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:18.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:19.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:19.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:19.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:19.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:19.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:19.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:19.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:19.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:19.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:19.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:19.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:19.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:19.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:19.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:20.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:20.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:20.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:20.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:20.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:20.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:20.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:20.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:20.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:20.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:20.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:20.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:20.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:20.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:20.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:20.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:20.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:22.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:31:22.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:22.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:22.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:22.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:22.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:22.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:22.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:22.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:22.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:22.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:22.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:22.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:23.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:23.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:23.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:23.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:23.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:23.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:23.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:23.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:23.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:23.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:23.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:23.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:25.177 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:31:25.172+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:31:25.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:25.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:25.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:25.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:25.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:25.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:25.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:25.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:25.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:25.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:25.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:25.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:25.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:25.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:25.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:25.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:25.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:25.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:25.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:25.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:26.392 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:31:26.388+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:31:26.392 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:31:26.388+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:31:27.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:27.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:27.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:27.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:27.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:27.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:27.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:27.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:27.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:27.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:27.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:27.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:27.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:27.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:27.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:27.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:29.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:29.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:29.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:29.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:29.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:29.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:29.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:29.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:29.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:29.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:29.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:29.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:30.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:30.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:30.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:30.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:30.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:30.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:30.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:30.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:31.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:31.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:31.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:31.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:31.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.060+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:31.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:31.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:31.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:31.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:31.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:31.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:31.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:31.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:31.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:31.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:31.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:32.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:32.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:32.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:32.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:32.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:32.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:32.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:32.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:32.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:32.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:32.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:32.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:33.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:33.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:33.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:33.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:33.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:33.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:33.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:33.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:33.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:33.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:33.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:33.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:33.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:33.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:33.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:33.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:36.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:36.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:36.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:36.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:36.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:36.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:36.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:36.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:36.503 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:31:36.500+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:31:36.623 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:31:36.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:36.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:36.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:36.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:36.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:36.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:36.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:36.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:36.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:36.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:36.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:37.590 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:31:37.590 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:31:37.689 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2331,"stamp":"2023-09-23T08:31:36.408642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23067041099,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2183299,"num_read_kb":8579458,"num_write":2160155,"num_write_kb":8640991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4332,"num_omap_keys":72,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80254,"ondisk_log_size":80254,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21461508,"kb_used_data":16901732,"kb_used_omap":1367,"kb_used_meta":4558376,"kb_avail":261654012,"statfs":{"total":289910292480,"available":267933708288,"internally_reserved":0,"allocated":17307373568,"data_stored":21483572538,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1400345,"internal_metadata":4667777511},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,1,4,9,19,7,13,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11460608,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5652,"num_read_kb":22600,"num_write":5464,"num_write_kb":21856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001907"},"pg_stats":[{"pgid":"2.7","version":"86'267652","reported_seq":526508,"reported_epoch":86,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:31:34.882556+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:31:34.882556+0000","last_peered":"2023-09-23T08:31:34.882556+0000","last_clean":"2023-09-23T08:31:34.882556+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:31:34.882556+0000","last_undegraded":"2023-09-23T08:31:34.882556+0000","last_fullsized":"2023-09-23T08:31:34.882556+0000","mapping_epoch":13,"log_start":"83'257610","ondisk_log_start":"83'257610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":101,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 46s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2719281487,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":258376,"num_read_kb":1015362,"num_write":254623,"num_write_kb":1018396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"86'295118","reported_seq":580751,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:34.847930+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:31:34.847930+0000","last_peered":"2023-09-23T08:31:34.847930+0000","last_clean":"2023-09-23T08:31:34.847930+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:31:34.847930+0000","last_undegraded":"2023-09-23T08:31:34.847930+0000","last_fullsized":"2023-09-23T08:31:34.847930+0000","mapping_epoch":13,"log_start":"83'285107","ondisk_log_start":"83'285107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3036139839,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":285941,"num_read_kb":1119618,"num_write":282193,"num_write_kb":1128541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"86'279157","reported_seq":547955,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:34.877482+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:31:34.877482+0000","last_peered":"2023-09-23T08:31:34.877482+0000","last_clean":"2023-09-23T08:31:34.877482+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:31:34.877482+0000","last_undegraded":"2023-09-23T08:31:34.877482+0000","last_fullsized":"2023-09-23T08:31:34.877482+0000","mapping_epoch":13,"log_start":"83'269109","ondisk_log_start":"83'269109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2828935468,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":268322,"num_read_kb":1054389,"num_write":266211,"num_write_kb":1064757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"86'284008","reported_seq":568530,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:34.881979+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:31:34.881979+0000","last_peered":"2023-09-23T08:31:34.881979+0000","last_clean":"2023-09-23T08:31:34.881979+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:31:34.881979+0000","last_undegraded":"2023-09-23T08:31:34.881979+0000","last_fullsized":"2023-09-23T08:31:34.881979+0000","mapping_epoch":13,"log_start":"83'274007","ondisk_log_start":"83'274007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3026673946,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":285161,"num_read_kb":1126587,"num_write":283220,"num_write_kb":1132793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"86'277516","reported_seq":554009,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:36.194386+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:31:36.194386+0000","last_peered":"2023-09-23T08:31:36.194386+0000","last_clean":"2023-09-23T08:31:36.194386+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:31:36.194386+0000","last_undegraded":"2023-09-23T08:31:36.194386+0000","last_fullsized":"2023-09-23T08:31:36.194386+0000","mapping_epoch":13,"log_start":"83'267509","ondisk_log_start":"83'267509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2920436030,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":276274,"num_read_kb":1085955,"num_write":274112,"num_write_kb":1096298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"86'286324","reported_seq":569664,"reported_epoch":86,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:31:32.884973+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:31:32.884973+0000","last_peered":"2023-09-23T08:31:32.884973+0000","last_clean":"2023-09-23T08:31:32.884973+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:31:32.884973+0000","last_undegraded":"2023-09-23T08:31:32.884973+0000","last_fullsized":"2023-09-23T08:31:32.884973+0000","mapping_epoch":13,"log_start":"83'276311","ondisk_log_start":"83'276311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":352,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 152s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3007377878,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":282865,"num_read_kb":1110900,"num_write":280293,"num_write_kb":1121052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"86'262313","reported_seq":521720,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:32.874140+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:31:32.874140+0000","last_peered":"2023-09-23T08:31:32.874140+0000","last_clean":"2023-09-23T08:31:32.874140+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:31:32.874140+0000","last_undegraded":"2023-09-23T08:31:32.874140+0000","last_fullsized":"2023-09-23T08:31:32.874140+0000","mapping_epoch":13,"log_start":"83'252308","ondisk_log_start":"83'252308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2727964973,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":258703,"num_read_kb":1016041,"num_write":255753,"num_write_kb":1022925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"86'277334","reported_seq":545460,"reported_epoch":86,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:31:34.844731+0000","last_change":"2023-09-23T08:22:41.174420+0000","last_active":"2023-09-23T08:31:34.844731+0000","last_peered":"2023-09-23T08:31:34.844731+0000","last_clean":"2023-09-23T08:31:34.844731+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:31:34.844731+0000","last_undegraded":"2023-09-23T08:31:34.844731+0000","last_fullsized":"2023-09-23T08:31:34.844731+0000","mapping_epoch":13,"log_start":"83'267306","ondisk_log_start":"83'267306","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1169,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 533s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2799641110,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":267551,"num_read_kb":1050515,"num_write":263613,"num_write_kb":1054335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":259,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:23.189835+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:30:23.189835+0000","last_peered":"2023-09-23T08:30:23.189835+0000","last_clean":"2023-09-23T08:30:23.189835+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:30:23.189835+0000","last_undegraded":"2023-09-23T08:30:23.189835+0000","last_fullsized":"2023-09-23T08:30:23.189835+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23066450731,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2183193,"num_read_kb":8579367,"num_write":2160018,"num_write_kb":8639097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4332,"num_omap_keys":72,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17306349568,"data_stored":21482595926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80155,"ondisk_log_size":80155,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739268,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4660972,"kb_used_data":3129380,"kb_used_omap":220,"kb_used_meta":1531363,"kb_avail":89710868,"statfs":{"total":96636764160,"available":91863928832,"internally_reserved":0,"allocated":3204485120,"data_stored":3968991397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1568115901},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,8,0,2,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:31:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.57499999999999996,"15min":0.746},"min":{"1min":0.186,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":6.1630000000000003,"5min":6.1630000000000003,"15min":10.922000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.626,"15min":0.88100000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":6.2009999999999996,"5min":6.2009999999999996,"15min":10.954000000000001},"last":0.26100000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:31:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.85299999999999998,"15min":0.92000000000000004},"min":{"1min":0.24099999999999999,"5min":0.215,"15min":0.215},"max":{"1min":4.0039999999999996,"5min":5.2489999999999997,"15min":11.65},"last":6.7629999999999999},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.1679999999999999,"15min":1.2250000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.182},"max":{"1min":6.1849999999999996,"5min":14.311999999999999,"15min":14.311999999999999},"last":6.8559999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739257,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9891236,"kb_used_data":8450200,"kb_used_omap":732,"kb_used_meta":1440291,"kb_avail":84480604,"statfs":{"total":96636764160,"available":86508138496,"internally_reserved":0,"allocated":8653004800,"data_stored":10741369047,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":749646,"internal_metadata":1474858930},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,4,7,9,7,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":1.0609999999999999,"15min":0.88700000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":3.012,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.454,"15min":1.4039999999999999},"min":{"1min":0.22,"5min":0.193,"15min":0.18099999999999999},"max":{"1min":9.7949999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.85599999999999998,"15min":0.95699999999999996},"min":{"1min":0.249,"5min":0.23000000000000001,"15min":0.19700000000000001},"max":{"1min":4.9119999999999999,"5min":9.0980000000000008,"15min":26.117000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.95799999999999996,"15min":0.93799999999999994},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":0.70499999999999996,"5min":11.98,"15min":26.151},"last":0.41999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739264,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6909300,"kb_used_data":5322152,"kb_used_omap":414,"kb_used_meta":1586721,"kb_avail":87462540,"statfs":{"total":96636764160,"available":89561640960,"internally_reserved":0,"allocated":5449883648,"data_stored":6773212094,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":424584,"internal_metadata":1624802680},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,1,2,0,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:31:05 2023","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.0289999999999999,"15min":1.2490000000000001},"min":{"1min":0.223,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":7.2510000000000003,"5min":7.2510000000000003,"15min":21.207000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":2.2210000000000001,"5min":1.2290000000000001,"15min":0.98199999999999998},"min":{"1min":0.25600000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":7.2949999999999999,"5min":7.2949999999999999,"15min":20.436},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:30:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.89200000000000002,"15min":0.79700000000000004},"min":{"1min":0.193,"5min":0.193,"15min":0.186},"max":{"1min":4.04,"5min":12.529,"15min":15.039999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.68600000000000005,"15min":0.78400000000000003},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.218},"max":{"1min":0.96299999999999997,"5min":12.388,"15min":21.757999999999999},"last":0.47799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5449220096,"data_stored":6772422162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8653078528,"data_stored":10741222187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3204050944,"data_stored":3968951577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:31:37.691 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:37.691 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:37.691 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:37.691 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:37.692 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:37.692 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:37.692 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:31:39.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:39.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:39.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:39.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:39.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:39.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:39.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:39.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:39.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:39.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:39.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:39.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:39.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:39.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:40.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:40.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:40.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:40.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:40.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:40.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:40.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:40.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:40.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:40.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:40.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:40.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:40.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:40.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:40.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:40.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:42.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:42.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:42.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:42.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:42.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:42.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:42.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:42.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:42.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:42.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:42.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:42.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:42.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:42.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:42.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:42.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:44.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:44.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:44.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:44.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:44.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:44.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:44.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:44.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:44.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:44.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:44.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:44.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:44.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:44.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:44.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:44.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:44.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:44.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:45.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:31:45.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:45.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:45.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:45.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:45.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:45.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:45.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:45.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:45.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:45.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:45.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:45.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:45.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:45.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:45.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:45.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:45.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:45.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:45.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:45.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:45.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:45.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:46.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:46.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:46.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:46.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:46.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:46.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:46.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:46.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:46.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:46.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:31:46.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:46.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:46.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:46.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:46.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:46.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:46.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:46.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:46.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:46.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:48.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:48.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:48.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:48.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:48.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:48.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:48.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:48.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:48.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:48.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:48.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:48.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:49.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:49.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:49.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:49.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:49.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:49.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:49.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:49.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:49.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:49.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:49.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:49.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:49.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:49.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:49.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:49.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:49.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:49.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:49.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:49.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:49.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:49.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:50.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:50.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:50.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:50.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:50.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:50.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:50.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:50.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:50.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:50.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:50.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:50.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:50.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:50.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:50.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:51.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:51.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:51.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:51.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:51.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:51.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:51.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:51.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:51.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:51.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:51.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:51.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:51.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:51.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:51.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:51.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:51.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:51.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:53.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:53.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:53.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:53.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:53.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:53.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:53.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:53.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:53.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:53.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:53.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:53.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:53.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:53.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:53.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:53.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:53.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:53.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:53.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:53.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:53.679 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:31:53.664+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:31:56.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:56.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:56.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:56.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:56.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:56.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:56.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:56.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:56.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:56.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:56.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:56.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:57.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:57.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:31:57.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:57.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:57.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:31:57.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:57.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:57.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:57.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:57.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:57.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:57.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:57.693 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:31:58.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:58.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:31:58.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:58.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:58.631 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:31:58.631 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:31:58.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:58.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:31:58.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:58.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:58.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:58.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:58.683 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2342,"stamp":"2023-09-23T08:31:58.418722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23084399947,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2191872,"num_read_kb":8613702,"num_write":2168468,"num_write_kb":8674243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80549,"ondisk_log_size":80549,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21758088,"kb_used_data":16940520,"kb_used_omap":1367,"kb_used_meta":4816168,"kb_avail":261357432,"statfs":{"total":289910292480,"available":267630010368,"internally_reserved":0,"allocated":17347092480,"data_stored":21518224698,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1400345,"internal_metadata":4931756519},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,5,8,8,15,10],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9248768,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4457,"num_read_kb":17804,"num_write":4409,"num_write_kb":17636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005492"},"pg_stats":[{"pgid":"2.7","version":"86'268668","reported_seq":528539,"reported_epoch":86,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:31:55.283990+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:31:55.283990+0000","last_peered":"2023-09-23T08:31:55.283990+0000","last_clean":"2023-09-23T08:31:55.283990+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:31:55.283990+0000","last_undegraded":"2023-09-23T08:31:55.283990+0000","last_fullsized":"2023-09-23T08:31:55.283990+0000","mapping_epoch":13,"log_start":"83'258610","ondisk_log_start":"83'258610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":148,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 67s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2721177935,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":259368,"num_read_kb":1019330,"num_write":255562,"num_write_kb":1022152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"86'296175","reported_seq":582886,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:55.354038+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:31:55.354038+0000","last_peered":"2023-09-23T08:31:55.354038+0000","last_clean":"2023-09-23T08:31:55.354038+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:31:55.354038+0000","last_undegraded":"2023-09-23T08:31:55.354038+0000","last_fullsized":"2023-09-23T08:31:55.354038+0000","mapping_epoch":13,"log_start":"84'286107","ondisk_log_start":"84'286107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3038355775,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":287010,"num_read_kb":1123890,"num_write":283199,"num_write_kb":1132565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"86'280161","reported_seq":549956,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:55.319333+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:31:55.319333+0000","last_peered":"2023-09-23T08:31:55.319333+0000","last_clean":"2023-09-23T08:31:55.319333+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:31:55.319333+0000","last_undegraded":"2023-09-23T08:31:55.319333+0000","last_fullsized":"2023-09-23T08:31:55.319333+0000","mapping_epoch":13,"log_start":"83'270109","ondisk_log_start":"83'270109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2830909740,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":269308,"num_read_kb":1058333,"num_write":267163,"num_write_kb":1068565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"86'285058","reported_seq":570650,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:55.301466+0000","last_change":"2023-09-23T07:31:06.948789+0000","last_active":"2023-09-23T08:31:55.301466+0000","last_peered":"2023-09-23T08:31:55.301466+0000","last_clean":"2023-09-23T08:31:55.301466+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:31:55.301466+0000","last_undegraded":"2023-09-23T08:31:55.301466+0000","last_fullsized":"2023-09-23T08:31:55.301466+0000","mapping_epoch":13,"log_start":"83'275007","ondisk_log_start":"83'275007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3028853018,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":286230,"num_read_kb":1130847,"num_write":284270,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"86'278559","reported_seq":556063,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:56.418370+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:31:56.418370+0000","last_peered":"2023-09-23T08:31:56.418370+0000","last_clean":"2023-09-23T08:31:56.418370+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:31:56.418370+0000","last_undegraded":"2023-09-23T08:31:56.418370+0000","last_fullsized":"2023-09-23T08:31:56.418370+0000","mapping_epoch":13,"log_start":"83'268509","ondisk_log_start":"83'268509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2922492222,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":277276,"num_read_kb":1089959,"num_write":275145,"num_write_kb":1100430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"86'287638","reported_seq":572318,"reported_epoch":86,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:31:58.190701+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:31:58.190701+0000","last_peered":"2023-09-23T08:31:58.190701+0000","last_clean":"2023-09-23T08:31:58.190701+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:31:58.190701+0000","last_undegraded":"2023-09-23T08:31:58.190701+0000","last_fullsized":"2023-09-23T08:31:58.190701+0000","mapping_epoch":13,"log_start":"84'277611","ondisk_log_start":"84'277611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":420,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 177s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3010023894,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":284177,"num_read_kb":1116144,"num_write":281529,"num_write_kb":1125996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"86'263476","reported_seq":524010,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:58.136010+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:31:58.136010+0000","last_peered":"2023-09-23T08:31:58.136010+0000","last_clean":"2023-09-23T08:31:58.136010+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:31:58.136010+0000","last_undegraded":"2023-09-23T08:31:58.136010+0000","last_fullsized":"2023-09-23T08:31:58.136010+0000","mapping_epoch":13,"log_start":"83'253408","ondisk_log_start":"83'253408","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2730352941,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":259820,"num_read_kb":1020497,"num_write":256883,"num_write_kb":1027445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"86'278382","reported_seq":547560,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:31:55.288279+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:31:55.288279+0000","last_peered":"2023-09-23T08:31:55.288279+0000","last_clean":"2023-09-23T08:31:55.288279+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:31:55.288279+0000","last_undegraded":"2023-09-23T08:31:55.288279+0000","last_fullsized":"2023-09-23T08:31:55.288279+0000","mapping_epoch":13,"log_start":"83'268306","ondisk_log_start":"83'268306","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2801644054,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":268577,"num_read_kb":1054611,"num_write":264580,"num_write_kb":1058203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":259,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:23.189835+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:30:23.189835+0000","last_peered":"2023-09-23T08:30:23.189835+0000","last_clean":"2023-09-23T08:30:23.189835+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:30:23.189835+0000","last_undegraded":"2023-09-23T08:30:23.189835+0000","last_fullsized":"2023-09-23T08:30:23.189835+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23083809579,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2191766,"num_read_kb":8613611,"num_write":2168331,"num_write_kb":8672349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17345548288,"data_stored":21516801622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80450,"ondisk_log_size":80450,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739273,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4719508,"kb_used_data":3137932,"kb_used_omap":220,"kb_used_meta":1581347,"kb_avail":89652332,"statfs":{"total":96636764160,"available":91803987968,"internally_reserved":0,"allocated":3213242368,"data_stored":3976597669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1619299517},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,2,4,10],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:31:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.57499999999999996,"15min":0.746},"min":{"1min":0.186,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":6.1630000000000003,"5min":6.1630000000000003,"15min":10.922000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.626,"15min":0.88100000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":6.2009999999999996,"5min":6.2009999999999996,"15min":10.954000000000001},"last":0.42499999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:31:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.85299999999999998,"15min":0.92000000000000004},"min":{"1min":0.24099999999999999,"5min":0.215,"15min":0.215},"max":{"1min":4.0039999999999996,"5min":5.2489999999999997,"15min":11.65},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.1679999999999999,"15min":1.2250000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.182},"max":{"1min":6.1849999999999996,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.34899999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739261,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10037364,"kb_used_data":8469156,"kb_used_omap":732,"kb_used_meta":1567459,"kb_avail":84334476,"statfs":{"total":96636764160,"available":86358503424,"internally_reserved":0,"allocated":8672415744,"data_stored":10758293719,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":749646,"internal_metadata":1605078962},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,5,7,4,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":1.0609999999999999,"15min":0.88700000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":3.012,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.454,"15min":1.4039999999999999},"min":{"1min":0.22,"5min":0.193,"15min":0.18099999999999999},"max":{"1min":9.7949999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.315}]},{"osd":2,"last update":"Sat Sep 23 08:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.85599999999999998,"15min":0.95699999999999996},"min":{"1min":0.249,"5min":0.23000000000000001,"15min":0.19700000000000001},"max":{"1min":4.9119999999999999,"5min":9.0980000000000008,"15min":26.117000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.95799999999999996,"15min":0.93799999999999994},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":0.70499999999999996,"5min":11.98,"15min":26.151},"last":0.503}]}]},{"osd":0,"up_from":8,"seq":34359739268,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7001216,"kb_used_data":5333432,"kb_used_omap":414,"kb_used_meta":1667361,"kb_avail":87370624,"statfs":{"total":96636764160,"available":89467518976,"internally_reserved":0,"allocated":5461434368,"data_stored":6783333310,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":424584,"internal_metadata":1707378040},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:31:05 2023","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.0289999999999999,"15min":1.2490000000000001},"min":{"1min":0.223,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":7.2510000000000003,"5min":7.2510000000000003,"15min":21.207000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":2.2210000000000001,"5min":1.2290000000000001,"15min":0.98199999999999998},"min":{"1min":0.25600000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":7.2949999999999999,"5min":7.2949999999999999,"15min":20.436},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:31:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.0049999999999999,"15min":0.82599999999999996},"min":{"1min":0.215,"5min":0.193,"15min":0.186},"max":{"1min":6.9809999999999999,"5min":12.529,"15min":15.039999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":1.532,"5min":0.91300000000000003,"15min":0.85999999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":7.0410000000000004,"5min":12.388,"15min":21.757999999999999},"last":0.33100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5460697088,"data_stored":6782486034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8672256000,"data_stored":10757946155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3212595200,"data_stored":3976369433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:31:58.684 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:58.685 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:58.685 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:58.685 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:58.685 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:31:58.685 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:31:58.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:58.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:58.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:58.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:58.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:58.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:58.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:58.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:31:59.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:59.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:31:59.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:59.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:31:59.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:59.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:31:59.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:59.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:31:59.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:59.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:31:59.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:59.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:31:59.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:31:59.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:00.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:00.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:00.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:00.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:00.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:00.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:00.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:00.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:00.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:00.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:00.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:00.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:00.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:00.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:00.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:00.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:00.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:00.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:00.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:00.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:00.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:00.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:01.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:01.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:01.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:01.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:01.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:01.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:01.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:01.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:01.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:01.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:32:01.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:01.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:01.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:01.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:01.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:01.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:01.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:01.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:01.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:01.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:01.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:01.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:02.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:02.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:02.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:02.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:02.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:02.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:02.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:02.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:02.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:02.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:02.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:02.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:04.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:04.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:04.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:04.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:04.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:04.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:04.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:04.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:04.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:04.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:04.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:04.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:06.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:32:06.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:06.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:06.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:06.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:06.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:06.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:06.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:06.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:06.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:06.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:06.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:06.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:07.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:07.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:07.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:07.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:08.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:07.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:08.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:08.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:08.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:08.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:08.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:08.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:08.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:08.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:08.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:08.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:08.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:08.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:08.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:08.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:08.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:08.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:08.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:09.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:09.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:09.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:09.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:09.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:09.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:09.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:09.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:09.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:32:09.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:09.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:09.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:09.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:09.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:09.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:09.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:11.211 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:11.204+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:32:11.213 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:11.208+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:32:11.213 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:11.208+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:32:12.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:12.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:12.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:12.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:12.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:12.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:12.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:12.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:12.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:12.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:12.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:12.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:12.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:12.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:12.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:12.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:13.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:13.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:13.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:13.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:13.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:13.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:13.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:13.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:13.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:13.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:13.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:13.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:13.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:13.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:13.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:13.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:14.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:14.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:14.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:14.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:14.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:14.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:14.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:14.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:14.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:14.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:14.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:14.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:14.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:14.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:14.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:14.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:14.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:14.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:14.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:18.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:32:18.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:18.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:18.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:18.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:18.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:18.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:18.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:18.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:18.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:18.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:18.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:18.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:18.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:18.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:18.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:18.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:19.596 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:32:19.596 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:32:19.638 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2353,"stamp":"2023-09-23T08:32:18.423975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23100239179,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2199706,"num_read_kb":8645022,"num_write":2176086,"num_write_kb":8704715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80420,"ondisk_log_size":80420,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22081836,"kb_used_data":16975564,"kb_used_omap":1367,"kb_used_meta":5104872,"kb_avail":261033684,"statfs":{"total":289910292480,"available":267298492416,"internally_reserved":0,"allocated":17382977536,"data_stored":21549267404,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1400345,"internal_metadata":5227389415},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4,0,9,3,9,17,14,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8224768,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4039,"num_read_kb":16156,"num_write":3981,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001896"},"pg_stats":[{"pgid":"2.7","version":"86'269592","reported_seq":530469,"reported_epoch":86,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:32:16.047377+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:32:16.047377+0000","last_peered":"2023-09-23T08:32:16.047377+0000","last_clean":"2023-09-23T08:32:16.047377+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:32:16.047377+0000","last_undegraded":"2023-09-23T08:32:16.047377+0000","last_fullsized":"2023-09-23T08:32:16.047377+0000","mapping_epoch":13,"log_start":"84'259510","ondisk_log_start":"84'259510","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":229,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 88s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2722820431,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":260351,"num_read_kb":1023262,"num_write":256381,"num_write_kb":1025428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"86'297256","reported_seq":584969,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:32:16.063136+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:32:16.063136+0000","last_peered":"2023-09-23T08:32:16.063136+0000","last_clean":"2023-09-23T08:32:16.063136+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:32:16.063136+0000","last_undegraded":"2023-09-23T08:32:16.063136+0000","last_fullsized":"2023-09-23T08:32:16.063136+0000","mapping_epoch":13,"log_start":"84'287207","ondisk_log_start":"84'287207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3040465215,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":287998,"num_read_kb":1127838,"num_write":284226,"num_write_kb":1136673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"86'281140","reported_seq":551931,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:32:16.052519+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:32:16.052519+0000","last_peered":"2023-09-23T08:32:16.052519+0000","last_clean":"2023-09-23T08:32:16.052519+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:32:16.052519+0000","last_undegraded":"2023-09-23T08:32:16.052519+0000","last_fullsized":"2023-09-23T08:32:16.052519+0000","mapping_epoch":13,"log_start":"84'271109","ondisk_log_start":"84'271109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2832822572,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":270290,"num_read_kb":1062261,"num_write":268086,"num_write_kb":1072257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"86'286095","reported_seq":572681,"reported_epoch":86,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:32:16.055211+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:32:16.055211+0000","last_peered":"2023-09-23T08:32:16.055211+0000","last_clean":"2023-09-23T08:32:16.055211+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:32:16.055211+0000","last_undegraded":"2023-09-23T08:32:16.055211+0000","last_fullsized":"2023-09-23T08:32:16.055211+0000","mapping_epoch":13,"log_start":"84'276007","ondisk_log_start":"84'276007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":30,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 20s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3030982938,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":287220,"num_read_kb":1134803,"num_write":285289,"num_write_kb":1141069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"86'279527","reported_seq":558044,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:32:16.416822+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:32:16.416822+0000","last_peered":"2023-09-23T08:32:16.416822+0000","last_clean":"2023-09-23T08:32:16.416822+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:32:16.416822+0000","last_undegraded":"2023-09-23T08:32:16.416822+0000","last_fullsized":"2023-09-23T08:32:16.416822+0000","mapping_epoch":13,"log_start":"84'269509","ondisk_log_start":"84'269509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2924536126,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":278279,"num_read_kb":1093967,"num_write":276105,"num_write_kb":1104270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"87'288721","reported_seq":574448,"reported_epoch":87,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:32:18.327445+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:32:18.327445+0000","last_peered":"2023-09-23T08:32:18.327445+0000","last_clean":"2023-09-23T08:32:18.327445+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:32:18.327445+0000","last_undegraded":"2023-09-23T08:32:18.327445+0000","last_fullsized":"2023-09-23T08:32:18.327445+0000","mapping_epoch":13,"log_start":"84'278711","ondisk_log_start":"84'278711","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":455,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 197s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3012346326,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":285204,"num_read_kb":1120248,"num_write":282575,"num_write_kb":1130180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"87'264426","reported_seq":525901,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:18.307391+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:32:18.307391+0000","last_peered":"2023-09-23T08:32:18.307391+0000","last_clean":"2023-09-23T08:32:18.307391+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:32:18.307391+0000","last_undegraded":"2023-09-23T08:32:18.307391+0000","last_fullsized":"2023-09-23T08:32:18.307391+0000","mapping_epoch":13,"log_start":"84'254408","ondisk_log_start":"84'254408","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2732192045,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":260743,"num_read_kb":1024189,"num_write":257815,"num_write_kb":1031173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"86'279331","reported_seq":549458,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-23T08:32:16.027908+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:32:16.027908+0000","last_peered":"2023-09-23T08:32:16.027908+0000","last_clean":"2023-09-23T08:32:16.027908+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:32:16.027908+0000","last_undegraded":"2023-09-23T08:32:16.027908+0000","last_fullsized":"2023-09-23T08:32:16.027908+0000","mapping_epoch":13,"log_start":"84'269306","ondisk_log_start":"84'269306","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2803483158,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":269515,"num_read_kb":1058363,"num_write":265472,"num_write_kb":1061771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":259,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-23T08:30:23.189835+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:30:23.189835+0000","last_peered":"2023-09-23T08:30:23.189835+0000","last_clean":"2023-09-23T08:30:23.189835+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:30:23.189835+0000","last_undegraded":"2023-09-23T08:30:23.189835+0000","last_fullsized":"2023-09-23T08:30:23.189835+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23099648811,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2199600,"num_read_kb":8644931,"num_write":2175949,"num_write_kb":8702821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17382043648,"data_stored":21548373590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80321,"ondisk_log_size":80321,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739277,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4792940,"kb_used_data":3144740,"kb_used_omap":220,"kb_used_meta":1647971,"kb_avail":89578900,"statfs":{"total":96636764160,"available":91728793600,"internally_reserved":0,"allocated":3220213760,"data_stored":3982597431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1687522493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,4,4,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65000000000000002,"15min":0.77200000000000002},"min":{"1min":0.191,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":4.359,"5min":6.1630000000000003,"15min":10.922000000000001},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.66700000000000004,"15min":0.85999999999999999},"min":{"1min":0.23699999999999999,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":4.327,"5min":6.2009999999999996,"15min":10.954000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:32:14 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.0029999999999999,"15min":0.96899999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":6.7629999999999999,"5min":6.7629999999999999,"15min":11.65},"last":2.7639999999999998},{"interface":"front","average":{"1min":1.843,"5min":1.331,"15min":1.278},"min":{"1min":0.245,"5min":0.20699999999999999,"15min":0.182},"max":{"1min":6.8559999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.498}]}]},{"osd":1,"up_from":8,"seq":34359739265,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10186764,"kb_used_data":8486652,"kb_used_omap":732,"kb_used_meta":1699363,"kb_avail":84185076,"statfs":{"total":96636764160,"available":86205517824,"internally_reserved":0,"allocated":8690331648,"data_stored":10773797079,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":749646,"internal_metadata":1740148658},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,0,9,2,3,12,8,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.0589999999999999,"15min":0.88100000000000001},"min":{"1min":0.23400000000000001,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":3.117,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":1.026,"5min":1.4279999999999999,"15min":1.4159999999999999},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.18099999999999999},"max":{"1min":5.0780000000000003,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.28000000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:32:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":0.95299999999999996,"15min":0.99199999999999999},"min":{"1min":0.252,"5min":0.23000000000000001,"15min":0.19700000000000001},"max":{"1min":10.798999999999999,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.88400000000000001,"15min":0.875},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":1.716,"5min":11.98,"15min":26.151},"last":3.8359999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739272,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7102132,"kb_used_data":5344172,"kb_used_omap":414,"kb_used_meta":1757537,"kb_avail":87269708,"statfs":{"total":96636764160,"available":89364180992,"internally_reserved":0,"allocated":5472432128,"data_stored":6792872894,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":424584,"internal_metadata":1799718264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,2,1,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:32:08 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.135,"15min":1.244},"min":{"1min":0.24399999999999999,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":4.7670000000000003,"5min":7.2510000000000003,"15min":21.207000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2989999999999999,"15min":1.02},"min":{"1min":0.27700000000000002,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":4.8259999999999996,"5min":7.2949999999999999,"15min":20.436},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:31:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.0049999999999999,"15min":0.82599999999999996},"min":{"1min":0.215,"5min":0.193,"15min":0.186},"max":{"1min":6.9809999999999999,"5min":12.529,"15min":15.039999999999999},"last":0.217},{"interface":"front","average":{"1min":1.532,"5min":0.91300000000000003,"15min":0.85999999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":7.0410000000000004,"5min":12.388,"15min":21.757999999999999},"last":0.32000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5472030720,"data_stored":6792320530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8690511872,"data_stored":10773744427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3219501056,"data_stored":3982308633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:32:19.640 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:32:19.640 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:32:19.640 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:32:19.640 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:32:19.640 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:32:19.641 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:32:20.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:20.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:20.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:20.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:20.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:20.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:20.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:20.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:20.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:20.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:20.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:20.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:20.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:20.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:20.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:20.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:20.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:20.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:21.022 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:21.016+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:32:21.022 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:21.016+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:32:22.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:22.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:22.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:22.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:22.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:22.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:22.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:22.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:22.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:22.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:22.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:22.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:22.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:22.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:22.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:22.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:22.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:22.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:22.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:22.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:26.718 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:26.712+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:32:26.719 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:26.712+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:32:26.719 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:26.712+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:32:27.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:27.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:32:27.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:27.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:27.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:27.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:27.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:27.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:27.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:27.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:27.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:27.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:27.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:27.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:27.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:27.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:27.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:27.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:27.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:27.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:29.926 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:29.920+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:32:30.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:30.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:30.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:30.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:30.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:30.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:30.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:30.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:30.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:30.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:30.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:30.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:30.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:30.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:30.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:30.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:30.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:30.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:31.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:31.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:31.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:31.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:31.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:31.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:31.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:31.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:31.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:31.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:31.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:31.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:31.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:31.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:31.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:31.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:31.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:31.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:32.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:32.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:32.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:32.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:32.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:32.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:32.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:32.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:32.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:32.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:32.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:32.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:32.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:33.087 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:33.083+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:32:33.087 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:33.083+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:32:33.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:33.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:33.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:33.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:33.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:33.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:33.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:33.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:33.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:33.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:33.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:33.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:34.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:34.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:34.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:34.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:34.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:34.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:34.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:34.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:34.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:34.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:34.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:34.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:34.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:34.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:34.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:34.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:34.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:34.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:34.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:34.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:36.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:32:36.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:36.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:36.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:36.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:36.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:36.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:36.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:36.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:36.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:36.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:36.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:32:36.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:36.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:36.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:36.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:36.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:36.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:36.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:36.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:36.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:36.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:36.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:36.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:39.642 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:32:39.972 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:39.967+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:32:40.387 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:32:40.389 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:32:40.450 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2363,"stamp":"2023-09-23T08:32:38.427169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23116225867,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2207533,"num_read_kb":8676322,"num_write":2183772,"num_write_kb":8735459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80382,"ondisk_log_size":80382,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22369624,"kb_used_data":17012528,"kb_used_omap":1367,"kb_used_meta":5355688,"kb_avail":260745896,"statfs":{"total":289910292480,"available":267003797504,"internally_reserved":0,"allocated":17420828672,"data_stored":21581603568,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1400345,"internal_metadata":5484224999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,2,2,7,19,16],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9261056,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4602,"num_read_kb":18404,"num_write":4528,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001940"},"pg_stats":[{"pgid":"2.7","version":"87'270581","reported_seq":532407,"reported_epoch":87,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:32:36.503761+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:32:36.503761+0000","last_peered":"2023-09-23T08:32:36.503761+0000","last_clean":"2023-09-23T08:32:36.503761+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:32:36.503761+0000","last_undegraded":"2023-09-23T08:32:36.503761+0000","last_fullsized":"2023-09-23T08:32:36.503761+0000","mapping_epoch":13,"log_start":"84'260510","ondisk_log_start":"84'260510","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":290,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 108s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2724716879,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":261281,"num_read_kb":1026982,"num_write":257298,"num_write_kb":1029096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"87'298267","reported_seq":587050,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:36.460768+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:32:36.460768+0000","last_peered":"2023-09-23T08:32:36.460768+0000","last_clean":"2023-09-23T08:32:36.460768+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:32:36.460768+0000","last_undegraded":"2023-09-23T08:32:36.460768+0000","last_fullsized":"2023-09-23T08:32:36.460768+0000","mapping_epoch":13,"log_start":"84'288207","ondisk_log_start":"84'288207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3042574655,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":289057,"num_read_kb":1132070,"num_write":285204,"num_write_kb":1140585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"87'282130","reported_seq":553915,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:36.440916+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:32:36.440916+0000","last_peered":"2023-09-23T08:32:36.440916+0000","last_clean":"2023-09-23T08:32:36.440916+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:32:36.440916+0000","last_undegraded":"2023-09-23T08:32:36.440916+0000","last_fullsized":"2023-09-23T08:32:36.440916+0000","mapping_epoch":13,"log_start":"84'272109","ondisk_log_start":"84'272109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2834743596,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":271271,"num_read_kb":1066185,"num_write":269042,"num_write_kb":1076081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"87'287126","reported_seq":574747,"reported_epoch":87,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:32:36.465986+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:32:36.465986+0000","last_peered":"2023-09-23T08:32:36.465986+0000","last_clean":"2023-09-23T08:32:36.465986+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:32:36.465986+0000","last_undegraded":"2023-09-23T08:32:36.465986+0000","last_fullsized":"2023-09-23T08:32:36.465986+0000","mapping_epoch":13,"log_start":"84'277107","ondisk_log_start":"84'277107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":66,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 40s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3033006362,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":288247,"num_read_kb":1138911,"num_write":286296,"num_write_kb":1145097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"87'280522","reported_seq":560007,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:36.927894+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:32:36.927894+0000","last_peered":"2023-09-23T08:32:36.927894+0000","last_clean":"2023-09-23T08:32:36.927894+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:32:36.927894+0000","last_undegraded":"2023-09-23T08:32:36.927894+0000","last_fullsized":"2023-09-23T08:32:36.927894+0000","mapping_epoch":13,"log_start":"84'270509","ondisk_log_start":"84'270509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2926567742,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":279239,"num_read_kb":1097803,"num_write":277092,"num_write_kb":1108218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"87'289818","reported_seq":576553,"reported_epoch":87,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:32:38.403622+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:32:38.403622+0000","last_peered":"2023-09-23T08:32:38.403622+0000","last_clean":"2023-09-23T08:32:38.403622+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:32:38.403622+0000","last_undegraded":"2023-09-23T08:32:38.403622+0000","last_fullsized":"2023-09-23T08:32:38.403622+0000","mapping_epoch":13,"log_start":"84'279811","ondisk_log_start":"84'279811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":487,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 217s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3014648278,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":286194,"num_read_kb":1124208,"num_write":283627,"num_write_kb":1134388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"87'265351","reported_seq":527798,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:38.365272+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:32:38.365272+0000","last_peered":"2023-09-23T08:32:38.365272+0000","last_clean":"2023-09-23T08:32:38.365272+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:32:38.365272+0000","last_undegraded":"2023-09-23T08:32:38.365272+0000","last_fullsized":"2023-09-23T08:32:38.365272+0000","mapping_epoch":13,"log_start":"84'255308","ondisk_log_start":"84'255308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2734014765,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":261703,"num_read_kb":1028029,"num_write":258713,"num_write_kb":1034765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"87'280255","reported_seq":551316,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:36.411793+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:32:36.411793+0000","last_peered":"2023-09-23T08:32:36.411793+0000","last_clean":"2023-09-23T08:32:36.411793+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:32:36.411793+0000","last_undegraded":"2023-09-23T08:32:36.411793+0000","last_fullsized":"2023-09-23T08:32:36.411793+0000","mapping_epoch":13,"log_start":"84'270206","ondisk_log_start":"84'270206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2805363222,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":270435,"num_read_kb":1062043,"num_write":266363,"num_write_kb":1065335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":261,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:17.144671+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:32:17.144671+0000","last_peered":"2023-09-23T08:32:17.144671+0000","last_clean":"2023-09-23T08:32:17.144671+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:32:17.144671+0000","last_undegraded":"2023-09-23T08:32:17.144671+0000","last_fullsized":"2023-09-23T08:32:17.144671+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23115635499,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2207427,"num_read_kb":8676231,"num_write":2183635,"num_write_kb":8733565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17418977280,"data_stored":21579925078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80283,"ondisk_log_size":80283,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739281,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4855024,"kb_used_data":3151336,"kb_used_omap":220,"kb_used_meta":1703459,"kb_avail":89516816,"statfs":{"total":96636764160,"available":91665219584,"internally_reserved":0,"allocated":3226968064,"data_stored":3988372791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1744342205},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,1,3,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65000000000000002,"15min":0.77200000000000002},"min":{"1min":0.191,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":4.359,"5min":6.1630000000000003,"15min":10.922000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.66700000000000004,"15min":0.85999999999999999},"min":{"1min":0.23699999999999999,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":4.327,"5min":6.2009999999999996,"15min":10.954000000000001},"last":0.312}]},{"osd":1,"last update":"Sat Sep 23 08:32:14 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.0029999999999999,"15min":0.96899999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":6.7629999999999999,"5min":6.7629999999999999,"15min":11.65},"last":0.27200000000000002},{"interface":"front","average":{"1min":1.843,"5min":1.331,"15min":1.278},"min":{"1min":0.245,"5min":0.20699999999999999,"15min":0.182},"max":{"1min":6.8559999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.255}]}]},{"osd":1,"up_from":8,"seq":34359739269,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10279828,"kb_used_data":8505352,"kb_used_omap":732,"kb_used_meta":1773731,"kb_avail":84092012,"statfs":{"total":96636764160,"available":86110220288,"internally_reserved":0,"allocated":8709480448,"data_stored":10790155625,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":749646,"internal_metadata":1816301490},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,1,1,2,12,12],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.0589999999999999,"15min":0.88100000000000001},"min":{"1min":0.23400000000000001,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":3.117,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":1.026,"5min":1.4279999999999999,"15min":1.4159999999999999},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.18099999999999999},"max":{"1min":5.0780000000000003,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.26100000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:32:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":0.95299999999999996,"15min":0.99199999999999999},"min":{"1min":0.252,"5min":0.23000000000000001,"15min":0.19700000000000001},"max":{"1min":10.798999999999999,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.88400000000000001,"15min":0.875},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":1.716,"5min":11.98,"15min":26.151},"last":0.48199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739276,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7234772,"kb_used_data":5355840,"kb_used_omap":414,"kb_used_meta":1878497,"kb_avail":87137068,"statfs":{"total":96636764160,"available":89228357632,"internally_reserved":0,"allocated":5484380160,"data_stored":6803075152,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":424584,"internal_metadata":1923581304},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,4,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:32:08 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.135,"15min":1.244},"min":{"1min":0.24399999999999999,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":4.7670000000000003,"5min":7.2510000000000003,"15min":21.207000000000001},"last":0.22900000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2989999999999999,"15min":1.02},"min":{"1min":0.27700000000000002,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":4.8259999999999996,"5min":7.2949999999999999,"15min":20.436},"last":0.26500000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:31:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.0049999999999999,"15min":0.82599999999999996},"min":{"1min":0.215,"5min":0.193,"15min":0.186},"max":{"1min":6.9809999999999999,"5min":12.529,"15min":15.039999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.532,"5min":0.91300000000000003,"15min":0.85999999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":7.0410000000000004,"5min":12.388,"15min":21.757999999999999},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5483667456,"data_stored":6802249234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8709021696,"data_stored":10789554987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3226288128,"data_stored":3988120857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:32:40.452 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:32:40.452 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:32:40.452 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:32:40.453 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:32:40.453 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:32:40.453 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:32:42.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:42.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:42.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:42.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:42.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:42.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:42.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:42.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:42.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:42.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:42.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:42.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:43.939 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:43.935+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:32:44.170 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:32:44.163+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:32:45.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:45.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:45.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:45.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:45.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:45.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:45.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:45.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:45.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:45.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:45.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:45.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:45.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:45.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:45.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:45.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:45.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:45.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:45.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:45.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:46.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:46.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:46.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:46.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:46.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:46.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:46.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:46.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:46.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:46.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:46.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:46.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:46.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:46.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:46.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:46.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:46.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:46.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:46.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:46.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:46.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:32:46.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:46.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:46.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:46.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:46.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:46.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:46.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:46.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:46.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:46.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:46.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:46.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:47.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:47.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:32:47.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:47.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:48.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:48.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:48.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:48.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:48.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:48.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:48.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:48.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:48.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:48.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:48.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:48.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:48.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:48.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:48.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:48.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:48.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:48.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:48.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:48.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:48.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:48.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:48.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:48.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:48.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:48.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:48.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:51.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:51.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:51.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:51.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:51.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:51.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:51.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:51.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:51.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:51.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:52.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:52.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:52.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:52.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:52.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:52.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:52.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:52.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:53.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:53.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:32:53.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:53.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:53.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:53.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:53.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:53.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:53.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:53.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:53.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:53.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:56.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:56.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:56.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:56.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:56.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:56.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:56.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:56.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:56.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:56.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:56.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:56.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:56.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:56.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:58.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:58.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:32:58.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:58.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:32:58.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:58.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:58.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:58.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:58.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:58.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:58.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:58.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:58.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:58.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:58.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:58.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:58.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:58.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:32:59.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:59.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:32:59.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:59.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:32:59.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:59.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:32:59.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:59.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:32:59.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:59.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:32:59.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:59.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:32:59.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:59.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:32:59.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:32:59.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:00.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:00.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:00.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:00.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:00.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:00.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:00.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:00.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:00.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:00.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:00.454 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:33:00.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:00.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:00.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:00.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:00.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:00.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:00.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:00.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:00.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:00.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:00.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:01.304 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:33:01.305 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:33:01.357 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2374,"stamp":"2023-09-23T08:33:00.430807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23132564811,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2215225,"num_read_kb":8707058,"num_write":2191636,"num_write_kb":8766915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80446,"ondisk_log_size":80446,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22656268,"kb_used_data":17048884,"kb_used_omap":1367,"kb_used_meta":5605992,"kb_avail":260459252,"statfs":{"total":289910292480,"available":266710274048,"internally_reserved":0,"allocated":17458057216,"data_stored":21613507312,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1400345,"internal_metadata":5740536295},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,6,5,11,9,9,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9093120,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4377,"num_read_kb":17484,"num_write":4459,"num_write_kb":17836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002019"},"pg_stats":[{"pgid":"2.7","version":"87'271569","reported_seq":534326,"reported_epoch":87,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:32:57.028327+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:32:57.028327+0000","last_peered":"2023-09-23T08:32:57.028327+0000","last_clean":"2023-09-23T08:32:57.028327+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:32:57.028327+0000","last_undegraded":"2023-09-23T08:32:57.028327+0000","last_fullsized":"2023-09-23T08:32:57.028327+0000","mapping_epoch":13,"log_start":"84'261510","ondisk_log_start":"84'261510","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":351,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 128s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2726682959,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":262192,"num_read_kb":1030618,"num_write":258210,"num_write_kb":1032744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"87'299324","reported_seq":589137,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:56.999244+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:32:56.999244+0000","last_peered":"2023-09-23T08:32:56.999244+0000","last_clean":"2023-09-23T08:32:56.999244+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:32:56.999244+0000","last_undegraded":"2023-09-23T08:32:56.999244+0000","last_fullsized":"2023-09-23T08:32:56.999244+0000","mapping_epoch":13,"log_start":"84'289307","ondisk_log_start":"84'289307","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3044749631,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":290076,"num_read_kb":1136138,"num_write":286225,"num_write_kb":1144669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"87'283168","reported_seq":555923,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:56.996123+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:32:56.996123+0000","last_peered":"2023-09-23T08:32:56.996123+0000","last_clean":"2023-09-23T08:32:56.996123+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:32:56.996123+0000","last_undegraded":"2023-09-23T08:32:56.996123+0000","last_fullsized":"2023-09-23T08:32:56.996123+0000","mapping_epoch":13,"log_start":"84'273109","ondisk_log_start":"84'273109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2836697388,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":272229,"num_read_kb":1070017,"num_write":270044,"num_write_kb":1080089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"87'288151","reported_seq":576757,"reported_epoch":87,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:32:56.950962+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:32:56.950962+0000","last_peered":"2023-09-23T08:32:56.950962+0000","last_clean":"2023-09-23T08:32:56.950962+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:32:56.950962+0000","last_undegraded":"2023-09-23T08:32:56.950962+0000","last_fullsized":"2023-09-23T08:32:56.950962+0000","mapping_epoch":13,"log_start":"84'278107","ondisk_log_start":"84'278107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":117,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 61s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3035046170,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":289219,"num_read_kb":1142795,"num_write":287290,"num_write_kb":1149073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"87'281478","reported_seq":561955,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:57.080546+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:32:57.080546+0000","last_peered":"2023-09-23T08:32:57.080546+0000","last_clean":"2023-09-23T08:32:57.080546+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:32:57.080546+0000","last_undegraded":"2023-09-23T08:32:57.080546+0000","last_fullsized":"2023-09-23T08:32:57.080546+0000","mapping_epoch":13,"log_start":"84'271409","ondisk_log_start":"84'271409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2928509246,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":280222,"num_read_kb":1101735,"num_write":278042,"num_write_kb":1112018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"87'290932","reported_seq":578658,"reported_epoch":87,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:32:58.433309+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:32:58.433309+0000","last_peered":"2023-09-23T08:32:58.433309+0000","last_clean":"2023-09-23T08:32:58.433309+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:32:58.433309+0000","last_undegraded":"2023-09-23T08:32:58.433309+0000","last_fullsized":"2023-09-23T08:32:58.433309+0000","mapping_epoch":13,"log_start":"84'280911","ondisk_log_start":"84'280911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":545,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 238s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3016966614,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":287164,"num_read_kb":1128084,"num_write":284683,"num_write_kb":1138612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"87'266312","reported_seq":529650,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:58.464406+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:32:58.464406+0000","last_peered":"2023-09-23T08:32:58.464406+0000","last_clean":"2023-09-23T08:32:58.464406+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:32:58.464406+0000","last_undegraded":"2023-09-23T08:32:58.464406+0000","last_fullsized":"2023-09-23T08:32:58.464406+0000","mapping_epoch":13,"log_start":"84'256308","ondisk_log_start":"84'256308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2735960365,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":262587,"num_read_kb":1031561,"num_write":259653,"num_write_kb":1038525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"87'281280","reported_seq":553345,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:56.991516+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:32:56.991516+0000","last_peered":"2023-09-23T08:32:56.991516+0000","last_clean":"2023-09-23T08:32:56.991516+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:32:56.991516+0000","last_undegraded":"2023-09-23T08:32:56.991516+0000","last_fullsized":"2023-09-23T08:32:56.991516+0000","mapping_epoch":13,"log_start":"84'271206","ondisk_log_start":"84'271206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2807362070,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":271430,"num_read_kb":1066019,"num_write":267352,"num_write_kb":1069291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":261,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:17.144671+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:32:17.144671+0000","last_peered":"2023-09-23T08:32:17.144671+0000","last_clean":"2023-09-23T08:32:17.144671+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:32:17.144671+0000","last_undegraded":"2023-09-23T08:32:17.144671+0000","last_fullsized":"2023-09-23T08:32:17.144671+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23131974443,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2215119,"num_read_kb":8706967,"num_write":2191499,"num_write_kb":8765021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17456427008,"data_stored":21612013142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80347,"ondisk_log_size":80347,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739285,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4875624,"kb_used_data":3158048,"kb_used_omap":220,"kb_used_meta":1717347,"kb_avail":89496216,"statfs":{"total":96636764160,"available":91644125184,"internally_reserved":0,"allocated":3233841152,"data_stored":3994262839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1758563517},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,3,4,7,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:32:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65000000000000002,"15min":0.77200000000000002},"min":{"1min":0.191,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":4.359,"5min":6.1630000000000003,"15min":10.922000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.66700000000000004,"15min":0.85999999999999999},"min":{"1min":0.23699999999999999,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":4.327,"5min":6.2009999999999996,"15min":10.954000000000001},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:32:14 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.0029999999999999,"15min":0.96899999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":6.7629999999999999,"5min":6.7629999999999999,"15min":11.65},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.843,"5min":1.331,"15min":1.278},"min":{"1min":0.245,"5min":0.20699999999999999,"15min":0.182},"max":{"1min":6.8559999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.34200000000000003}]}]},{"osd":1,"up_from":8,"seq":34359739273,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10462716,"kb_used_data":8524020,"kb_used_omap":732,"kb_used_meta":1937955,"kb_avail":83909124,"statfs":{"total":96636764160,"available":85922942976,"internally_reserved":0,"allocated":8728596480,"data_stored":10806547817,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":749646,"internal_metadata":1984466866},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,4,2,8,5,2,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.0589999999999999,"15min":0.88100000000000001},"min":{"1min":0.23400000000000001,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":3.117,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.4279999999999999,"15min":1.4159999999999999},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.18099999999999999},"max":{"1min":5.0780000000000003,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:32:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":0.95299999999999996,"15min":0.99199999999999999},"min":{"1min":0.252,"5min":0.23000000000000001,"15min":0.19700000000000001},"max":{"1min":10.798999999999999,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.88400000000000001,"15min":0.875},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":1.716,"5min":11.98,"15min":26.151},"last":0.47099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359739280,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7317928,"kb_used_data":5366816,"kb_used_omap":414,"kb_used_meta":1950689,"kb_avail":87053912,"statfs":{"total":96636764160,"available":89143205888,"internally_reserved":0,"allocated":5495619584,"data_stored":6812696656,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":424584,"internal_metadata":1997505912},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:32:08 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.135,"15min":1.244},"min":{"1min":0.24399999999999999,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":4.7670000000000003,"5min":7.2510000000000003,"15min":21.207000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2989999999999999,"15min":1.02},"min":{"1min":0.27700000000000002,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":4.8259999999999996,"5min":7.2949999999999999,"15min":20.436},"last":0.40200000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:32:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0149999999999999,"15min":0.82299999999999995},"min":{"1min":0.217,"5min":0.193,"15min":0.186},"max":{"1min":6.1120000000000001,"5min":12.529,"15min":15.039999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.88600000000000001,"15min":0.85599999999999998},"min":{"1min":0.23100000000000001,"5min":0.184,"15min":0.184},"max":{"1min":4.4829999999999997,"5min":12.388,"15min":21.757999999999999},"last":0.442}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5495033856,"data_stored":6811981330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8727932928,"data_stored":10805762859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3233460224,"data_stored":3994268953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:33:01.358 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:01.359 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:01.359 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:01.359 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:01.359 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:01.359 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:33:01.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:01.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:01.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:01.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:01.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:01.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:01.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:01.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:01.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:01.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:01.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:33:01.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:01.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:01.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:01.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:01.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:01.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:01.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:01.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:01.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:01.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:01.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:01.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:01.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:01.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:01.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:01.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:01.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:01.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:01.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:01.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:02.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:02.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:02.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:02.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:02.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:02.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:02.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:02.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:02.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:02.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:02.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:02.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:02.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:02.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:03.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:03.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:03.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:03.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:03.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:03.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:03.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:03.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:04.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:04.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:04.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:04.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:04.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:04.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:04.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:04.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:04.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:04.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:04.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:04.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:04.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:04.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:04.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:04.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:04.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:04.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:04.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:05.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:05.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:05.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:05.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:05.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:05.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:05.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:05.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:05.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:05.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:05.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:05.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:05.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:05.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:05.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:05.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:05.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:05.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:05.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:05.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:08.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:08.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:08.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:08.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:08.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:08.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:08.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:08.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:08.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:08.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:08.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:08.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:08.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:08.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:08.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:08.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:08.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:09.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:09.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:09.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:09.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:09.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:09.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:09.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:09.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:09.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:09.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:09.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:33:09.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:09.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:09.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:09.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:09.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:09.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:09.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:09.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:09.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:09.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:09.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:09.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:09.958 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:33:09.951+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:33:09.959 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:33:09.951+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:33:09.959 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:33:09.951+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:33:09.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:09.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:09.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:09.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:09.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:10.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:09.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:10.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:10.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:10.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:10.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:11.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:11.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:11.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:11.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:11.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:11.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:11.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:11.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:11.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:11.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:11.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:11.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:11.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:11.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:11.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:11.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:11.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:11.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:11.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:11.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:11.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:12.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:12.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:13.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:13.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:13.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:13.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:13.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:13.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:13.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:13.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:13.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:13.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:13.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:13.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:13.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:13.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:13.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:13.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:13.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:13.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:13.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:18.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:18.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:18.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:18.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:18.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:18.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:18.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:18.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:18.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:18.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:18.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:18.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:18.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:18.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:18.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:18.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:18.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:18.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:18.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:18.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:18.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:18.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:20.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:20.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:20.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:20.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:20.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:20.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:20.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:20.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:20.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:20.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:20.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:20.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:20.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:20.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:20.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:33:20.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:20.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:20.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:20.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:20.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:20.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:20.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:20.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:20.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:20.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:20.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:20.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:20.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:20.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:20.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:20.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:20.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:20.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:20.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:20.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:20.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:20.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:20.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:21.361 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:33:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:33:22.144 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:33:22.182 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2384,"stamp":"2023-09-23T08:33:20.434092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23148326219,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2222833,"num_read_kb":8737446,"num_write":2199362,"num_write_kb":8797819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80484,"ondisk_log_size":80484,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21988048,"kb_used_data":17084204,"kb_used_omap":1370,"kb_used_meta":4902437,"kb_avail":261127472,"statfs":{"total":289910292480,"available":267394531328,"internally_reserved":0,"allocated":17494224896,"data_stored":21644755696,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1403704,"internal_metadata":5020095688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2,3,6,12,12,6,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8896512,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4194,"num_read_kb":16744,"num_write":4352,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001969"},"pg_stats":[{"pgid":"2.7","version":"87'272523","reported_seq":536161,"reported_epoch":87,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:33:17.448850+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:33:17.448850+0000","last_peered":"2023-09-23T08:33:17.448850+0000","last_clean":"2023-09-23T08:33:17.448850+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:33:17.448850+0000","last_undegraded":"2023-09-23T08:33:17.448850+0000","last_fullsized":"2023-09-23T08:33:17.448850+0000","mapping_epoch":13,"log_start":"84'262511","ondisk_log_start":"84'262511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":428,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 149s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2728436047,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":263053,"num_read_kb":1034062,"num_write":259060,"num_write_kb":1036144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"87'300411","reported_seq":591211,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:33:17.409422+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:33:17.409422+0000","last_peered":"2023-09-23T08:33:17.409422+0000","last_clean":"2023-09-23T08:33:17.409422+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:33:17.409422+0000","last_undegraded":"2023-09-23T08:33:17.409422+0000","last_fullsized":"2023-09-23T08:33:17.409422+0000","mapping_epoch":13,"log_start":"85'290407","ondisk_log_start":"85'290407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3046949183,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":291055,"num_read_kb":1140050,"num_write":287251,"num_write_kb":1148773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"87'284195","reported_seq":557926,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:33:17.431363+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:33:17.431363+0000","last_peered":"2023-09-23T08:33:17.431363+0000","last_clean":"2023-09-23T08:33:17.431363+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:33:17.431363+0000","last_undegraded":"2023-09-23T08:33:17.431363+0000","last_fullsized":"2023-09-23T08:33:17.431363+0000","mapping_epoch":13,"log_start":"85'274109","ondisk_log_start":"85'274109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2838511916,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":273193,"num_read_kb":1073873,"num_write":271011,"num_write_kb":1083957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"87'289165","reported_seq":578727,"reported_epoch":87,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:33:17.438755+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:33:17.438755+0000","last_peered":"2023-09-23T08:33:17.438755+0000","last_clean":"2023-09-23T08:33:17.438755+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:33:17.438755+0000","last_undegraded":"2023-09-23T08:33:17.438755+0000","last_fullsized":"2023-09-23T08:33:17.438755+0000","mapping_epoch":13,"log_start":"85'279107","ondisk_log_start":"85'279107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":148,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 81s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3037061402,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":290167,"num_read_kb":1146583,"num_write":288285,"num_write_kb":1153053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"87'282466","reported_seq":563976,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:33:17.213472+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:33:17.213472+0000","last_peered":"2023-09-23T08:33:17.213472+0000","last_clean":"2023-09-23T08:33:17.213472+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:33:17.213472+0000","last_undegraded":"2023-09-23T08:33:17.213472+0000","last_fullsized":"2023-09-23T08:33:17.213472+0000","mapping_epoch":13,"log_start":"85'272409","ondisk_log_start":"85'272409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2930573630,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":281246,"num_read_kb":1105819,"num_write":279020,"num_write_kb":1115930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"87'292026","reported_seq":580738,"reported_epoch":87,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:33:18.691762+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:33:18.691762+0000","last_peered":"2023-09-23T08:33:18.691762+0000","last_clean":"2023-09-23T08:33:18.691762+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:33:18.691762+0000","last_undegraded":"2023-09-23T08:33:18.691762+0000","last_fullsized":"2023-09-23T08:33:18.691762+0000","mapping_epoch":13,"log_start":"85'282011","ondisk_log_start":"85'282011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":590,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 258s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3019088342,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":288131,"num_read_kb":1131944,"num_write":285715,"num_write_kb":1142740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"87'267266","reported_seq":531542,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:33:18.665521+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:33:18.665521+0000","last_peered":"2023-09-23T08:33:18.665521+0000","last_clean":"2023-09-23T08:33:18.665521+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:33:18.665521+0000","last_undegraded":"2023-09-23T08:33:18.665521+0000","last_fullsized":"2023-09-23T08:33:18.665521+0000","mapping_epoch":13,"log_start":"84'257208","ondisk_log_start":"84'257208","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2737828141,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":263516,"num_read_kb":1035273,"num_write":260568,"num_write_kb":1042185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"87'282301","reported_seq":555310,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:33:17.428995+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:33:17.428995+0000","last_peered":"2023-09-23T08:33:17.428995+0000","last_clean":"2023-09-23T08:33:17.428995+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:33:17.428995+0000","last_undegraded":"2023-09-23T08:33:17.428995+0000","last_fullsized":"2023-09-23T08:33:17.428995+0000","mapping_epoch":13,"log_start":"85'272206","ondisk_log_start":"85'272206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2809287190,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":272366,"num_read_kb":1069751,"num_write":268315,"num_write_kb":1073143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":261,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:17.144671+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:32:17.144671+0000","last_peered":"2023-09-23T08:32:17.144671+0000","last_clean":"2023-09-23T08:32:17.144671+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:32:17.144671+0000","last_undegraded":"2023-09-23T08:32:17.144671+0000","last_fullsized":"2023-09-23T08:32:17.144671+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23147735851,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2222727,"num_read_kb":8737355,"num_write":2199225,"num_write_kb":8795925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17492959232,"data_stored":21643556438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80385,"ondisk_log_size":80385,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739289,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4948980,"kb_used_data":3164780,"kb_used_omap":220,"kb_used_meta":1783971,"kb_avail":89422860,"statfs":{"total":96636764160,"available":91569008640,"internally_reserved":0,"allocated":3240734720,"data_stored":4000251191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1826786493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,5],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:33:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.72599999999999998,"15min":0.77300000000000002},"min":{"1min":0.19400000000000001,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":6.351,"5min":6.351,"15min":10.922000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64300000000000002,"15min":0.78200000000000003},"min":{"1min":0.23599999999999999,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":4.7350000000000003,"5min":6.2009999999999996,"15min":10.954000000000001},"last":0.23999999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:33:16 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.081,"15min":0.99399999999999999},"min":{"1min":0.27200000000000002,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":3.8999999999999999,"5min":6.7629999999999999,"15min":11.65},"last":0.36399999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.2529999999999999,"15min":1.331},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.182},"max":{"1min":5.3789999999999996,"5min":6.8559999999999999,"15min":14.311999999999999},"last":0.308}]}]},{"osd":1,"up_from":8,"seq":34359739277,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9926584,"kb_used_data":8541732,"kb_used_omap":733,"kb_used_meta":1384098,"kb_avail":84445256,"statfs":{"total":96636764160,"available":86471942144,"internally_reserved":0,"allocated":8746733568,"data_stored":10822202729,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":751325,"internal_metadata":1417316643},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,1,3,6,6,5,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:33:01 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.175,"15min":0.91400000000000003},"min":{"1min":0.248,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":11.917,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":2.2280000000000002,"5min":1.4990000000000001,"15min":1.4930000000000001},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.18099999999999999},"max":{"1min":15.718,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:33:01 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.88600000000000001,"15min":0.95199999999999996},"min":{"1min":0.26600000000000001,"5min":0.23000000000000001,"15min":0.19700000000000001},"max":{"1min":3.948,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.0249999999999999,"15min":0.91300000000000003},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":5.9279999999999999,"5min":11.98,"15min":26.151},"last":0.24399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739284,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7112484,"kb_used_data":5377692,"kb_used_omap":416,"kb_used_meta":1734367,"kb_avail":87259356,"statfs":{"total":96636764160,"available":89353580544,"internally_reserved":0,"allocated":5506756608,"data_stored":6822301776,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":1775992552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,3,4,1,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:33:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.198,"15min":1.222},"min":{"1min":0.188,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":7.3330000000000002,"5min":7.3330000000000002,"15min":21.207000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.302,"15min":1.0620000000000001},"min":{"1min":0.26400000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":7.3680000000000003,"5min":7.3680000000000003,"15min":20.436},"last":0.38500000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:32:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0149999999999999,"15min":0.82299999999999995},"min":{"1min":0.217,"5min":0.193,"15min":0.186},"max":{"1min":6.1120000000000001,"5min":12.529,"15min":15.039999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.88600000000000001,"15min":0.85599999999999998},"min":{"1min":0.23100000000000001,"5min":0.184,"15min":0.184},"max":{"1min":4.4829999999999997,"5min":12.388,"15min":21.757999999999999},"last":0.32000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5506281472,"data_stored":6821668370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8746311680,"data_stored":10821634859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3240366080,"data_stored":4000253209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:33:22.184 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:22.184 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:22.184 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:22.185 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:22.185 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:22.185 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:33:24.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:24.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:24.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:24.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:24.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:24.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:24.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:24.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:24.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:24.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:24.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:24.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:25.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:25.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:25.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:25.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:25.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:25.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:25.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:25.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:25.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:25.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:25.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:25.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:25.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:25.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:25.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:25.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:26.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:26.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:26.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:26.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:26.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:26.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:26.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:26.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:26.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:26.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:26.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:26.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:26.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:26.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:26.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:26.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:26.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:26.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:26.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:26.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:26.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:26.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:27.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:27.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:27.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:27.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:27.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:27.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:27.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:27.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:27.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:27.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:27.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:27.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:27.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:27.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:27.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:27.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:27.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:27.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:27.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:27.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:28.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:28.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:28.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:28.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:28.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:28.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:28.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:28.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:28.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:28.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:28.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:28.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:28.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:28.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:28.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:28.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:28.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:28.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:29.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:29.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:29.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:29.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:29.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:29.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:29.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:29.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:29.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:29.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:30.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:29.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:30.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:30.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:30.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:30.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:30.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:30.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:30.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:30.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:30.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:30.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:30.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:30.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:30.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:30.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:32.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:32.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:32.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:32.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:32.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:32.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:32.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:32.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.279+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:32.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:32.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:32.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:32.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:32.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:32.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:32.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:32.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:32.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:32.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:32.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:32.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:33.805 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:33:33.799+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:33:33.805 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:33:33.799+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:33:33.805 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:33:33.799+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:33:34.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:34.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:34.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:34.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:34.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:34.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:34.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:34.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:34.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:33:34.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:34.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:34.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:34.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:34.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:34.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:34.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:34.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:34.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:34.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:34.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:35.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:35.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:35.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:35.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:35.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:35.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:35.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:35.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:35.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:35.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:35.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:35.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:35.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:35.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:35.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:35.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:35.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:35.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:35.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:35.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:38.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:38.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:38.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:38.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:38.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:38.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:38.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:38.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:38.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:38.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:38.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:38.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:33:38.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:38.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:38.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:38.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:38.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:38.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:38.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:38.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:38.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:38.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:38.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:38.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:41.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:41.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:41.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:41.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:41.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:41.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:41.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:41.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:41.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:41.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:41.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:41.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:41.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:41.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:41.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:41.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:41.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:41.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:41.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:41.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:41.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:41.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:42.186 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:33:42.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:42.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:42.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:42.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:42.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:42.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:42.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:42.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:42.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:42.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:42.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:42.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:42.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:42.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:33:42.922 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:33:42.974 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2396,"stamp":"2023-09-23T08:33:42.440267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23163788619,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2230428,"num_read_kb":8767786,"num_write":2207092,"num_write_kb":8828739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80610,"ondisk_log_size":80610,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22270740,"kb_used_data":17119476,"kb_used_omap":1370,"kb_used_meta":5149861,"kb_avail":260844780,"statfs":{"total":289910292480,"available":267105054720,"internally_reserved":0,"allocated":17530343424,"data_stored":21676116005,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1403704,"internal_metadata":5273457864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,6,17,13,14,8],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7684096,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3807,"num_read_kb":15216,"num_write":3887,"num_write_kb":15548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.295427"},"pg_stats":[{"pgid":"2.7","version":"88'273542","reported_seq":538079,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:33:37.869055+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:33:37.869055+0000","last_peered":"2023-09-23T08:33:37.869055+0000","last_clean":"2023-09-23T08:33:37.869055+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:33:37.869055+0000","last_undegraded":"2023-09-23T08:33:37.869055+0000","last_fullsized":"2023-09-23T08:33:37.869055+0000","mapping_epoch":13,"log_start":"85'263511","ondisk_log_start":"85'263511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":484,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 169s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2730271055,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":263931,"num_read_kb":1037570,"num_write":259988,"num_write_kb":1039856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'301540","reported_seq":593384,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:37.854361+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:33:37.854361+0000","last_peered":"2023-09-23T08:33:37.854361+0000","last_clean":"2023-09-23T08:33:37.854361+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:33:37.854361+0000","last_undegraded":"2023-09-23T08:33:37.854361+0000","last_fullsized":"2023-09-23T08:33:37.854361+0000","mapping_epoch":13,"log_start":"85'291507","ondisk_log_start":"85'291507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3049173311,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":292084,"num_read_kb":1144166,"num_write":288323,"num_write_kb":1153061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'285193","reported_seq":559841,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:37.835743+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:33:37.835743+0000","last_peered":"2023-09-23T08:33:37.835743+0000","last_clean":"2023-09-23T08:33:37.835743+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:33:37.835743+0000","last_undegraded":"2023-09-23T08:33:37.835743+0000","last_fullsized":"2023-09-23T08:33:37.835743+0000","mapping_epoch":13,"log_start":"85'275109","ondisk_log_start":"85'275109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2840256812,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":274096,"num_read_kb":1077481,"num_write":271951,"num_write_kb":1087717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'290207","reported_seq":580787,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:33:37.854576+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:33:37.854576+0000","last_peered":"2023-09-23T08:33:37.854576+0000","last_clean":"2023-09-23T08:33:37.854576+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:33:37.854576+0000","last_undegraded":"2023-09-23T08:33:37.854576+0000","last_fullsized":"2023-09-23T08:33:37.854576+0000","mapping_epoch":13,"log_start":"85'280107","ondisk_log_start":"85'280107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":187,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 102s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3039035674,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":291180,"num_read_kb":1150631,"num_write":289299,"num_write_kb":1157109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'283484","reported_seq":565975,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:37.394251+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:33:37.394251+0000","last_peered":"2023-09-23T08:33:37.394251+0000","last_clean":"2023-09-23T08:33:37.394251+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:33:37.394251+0000","last_undegraded":"2023-09-23T08:33:37.394251+0000","last_fullsized":"2023-09-23T08:33:37.394251+0000","mapping_epoch":13,"log_start":"85'273409","ondisk_log_start":"85'273409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2932609342,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":282218,"num_read_kb":1109691,"num_write":280030,"num_write_kb":1119970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'293056","reported_seq":582742,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:33:38.846048+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:33:38.846048+0000","last_peered":"2023-09-23T08:33:38.846048+0000","last_clean":"2023-09-23T08:33:38.846048+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:33:38.846048+0000","last_undegraded":"2023-09-23T08:33:38.846048+0000","last_fullsized":"2023-09-23T08:33:38.846048+0000","mapping_epoch":13,"log_start":"85'283011","ondisk_log_start":"85'283011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":672,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 278s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3021095382,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":289084,"num_read_kb":1135752,"num_write":286670,"num_write_kb":1146560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'268197","reported_seq":533377,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:38.798500+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:33:38.798500+0000","last_peered":"2023-09-23T08:33:38.798500+0000","last_clean":"2023-09-23T08:33:38.798500+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:33:38.798500+0000","last_undegraded":"2023-09-23T08:33:38.798500+0000","last_fullsized":"2023-09-23T08:33:38.798500+0000","mapping_epoch":13,"log_start":"85'258108","ondisk_log_start":"85'258108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2739712301,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":264402,"num_read_kb":1038817,"num_write":261478,"num_write_kb":1045825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'283260","reported_seq":557244,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:37.839658+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:33:37.839658+0000","last_peered":"2023-09-23T08:33:37.839658+0000","last_clean":"2023-09-23T08:33:37.839658+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:33:37.839658+0000","last_undegraded":"2023-09-23T08:33:37.839658+0000","last_fullsized":"2023-09-23T08:33:37.839658+0000","mapping_epoch":13,"log_start":"85'273206","ondisk_log_start":"85'273206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2811044374,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":273327,"num_read_kb":1073587,"num_write":269216,"num_write_kb":1076747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":262,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:26.293248+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:32:26.293248+0000","last_peered":"2023-09-23T08:32:26.293248+0000","last_clean":"2023-09-23T08:32:26.293248+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:32:26.293248+0000","last_undegraded":"2023-09-23T08:32:26.293248+0000","last_fullsized":"2023-09-23T08:32:26.293248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23163198251,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2230322,"num_read_kb":8767695,"num_write":2206955,"num_write_kb":8826845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17529008128,"data_stored":21674853974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80511,"ondisk_log_size":80511,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739293,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4983292,"kb_used_data":3171316,"kb_used_omap":220,"kb_used_meta":1811747,"kb_avail":89388548,"statfs":{"total":96636764160,"available":91533873152,"internally_reserved":0,"allocated":3247427584,"data_stored":4006119838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1855229117},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,2,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:33:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.72599999999999998,"15min":0.77300000000000002},"min":{"1min":0.19400000000000001,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":6.351,"5min":6.351,"15min":10.922000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64300000000000002,"15min":0.78200000000000003},"min":{"1min":0.23599999999999999,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":4.7350000000000003,"5min":6.2009999999999996,"15min":10.954000000000001},"last":0.372}]},{"osd":1,"last update":"Sat Sep 23 08:33:16 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.081,"15min":0.99399999999999999},"min":{"1min":0.27200000000000002,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":3.8999999999999999,"5min":6.7629999999999999,"15min":11.65},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.278,"5min":1.2529999999999999,"15min":1.331},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.182},"max":{"1min":5.3789999999999996,"5min":6.8559999999999999,"15min":14.311999999999999},"last":0.311}]}]},{"osd":1,"up_from":8,"seq":34359739281,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10079240,"kb_used_data":8559736,"kb_used_omap":733,"kb_used_meta":1518754,"kb_avail":84292600,"statfs":{"total":96636764160,"available":86315622400,"internally_reserved":0,"allocated":8765169664,"data_stored":10838221264,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":751325,"internal_metadata":1555204387},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,2,13,8,7,8],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:33:01 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.175,"15min":0.91400000000000003},"min":{"1min":0.248,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":11.917,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":2.2280000000000002,"5min":1.4990000000000001,"15min":1.4930000000000001},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.18099999999999999},"max":{"1min":15.718,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:33:01 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.88600000000000001,"15min":0.95199999999999996},"min":{"1min":0.26600000000000001,"5min":0.23000000000000001,"15min":0.19700000000000001},"max":{"1min":3.948,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.0249999999999999,"15min":0.91300000000000003},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":5.9279999999999999,"5min":11.98,"15min":26.151},"last":0.33500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739288,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7208208,"kb_used_data":5388424,"kb_used_omap":416,"kb_used_meta":1819359,"kb_avail":87163632,"statfs":{"total":96636764160,"available":89255559168,"internally_reserved":0,"allocated":5517746176,"data_stored":6831774903,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":1863024360},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,3,3,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:33:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.198,"15min":1.222},"min":{"1min":0.188,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":7.3330000000000002,"5min":7.3330000000000002,"15min":21.207000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.302,"15min":1.0620000000000001},"min":{"1min":0.26400000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":7.3680000000000003,"5min":7.3680000000000003,"15min":20.436},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:32:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0149999999999999,"15min":0.82299999999999995},"min":{"1min":0.217,"5min":0.193,"15min":0.186},"max":{"1min":6.1120000000000001,"5min":12.529,"15min":15.039999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.88600000000000001,"15min":0.85599999999999998},"min":{"1min":0.23100000000000001,"5min":0.184,"15min":0.184},"max":{"1min":4.4829999999999997,"5min":12.388,"15min":21.757999999999999},"last":0.311}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5517520896,"data_stored":6831371794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8764465152,"data_stored":10837392171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3247022080,"data_stored":4006090009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:33:42.976 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:42.976 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:42.976 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:42.976 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:42.977 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:33:42.977 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:33:43.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:43.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:43.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:43.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:43.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:43.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:43.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:43.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:43.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:43.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:43.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:43.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:44.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:44.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:44.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:44.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:44.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:44.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:44.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:44.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:44.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:44.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:44.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:44.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:44.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:44.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:44.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:44.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:45.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:45.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:45.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:45.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:45.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:45.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:45.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:45.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:45.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:45.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:45.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:45.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:46.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:46.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:46.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:46.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:46.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:46.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:46.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:46.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:46.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:46.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:46.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:46.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:50.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:50.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:50.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:50.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:50.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:50.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:50.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:50.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:50.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:50.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:50.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:50.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:51.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:51.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:51.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:51.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:51.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:51.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:51.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:51.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:51.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:51.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:51.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:51.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:51.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:51.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:51.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:51.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:51.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:51.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:51.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:51.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:51.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:52.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:52.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:52.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:52.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:52.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:52.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:52.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:52.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:52.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:52.771 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:33:52.766+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:33:52.771 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:33:52.766+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:33:52.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:52.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:52.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:52.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:52.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:52.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:52.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:52.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:52.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:52.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:52.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:52.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:54.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:33:54.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:54.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:54.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:54.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:54.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:54.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:54.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:54.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:54.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:54.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:54.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:33:54.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:54.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:54.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:54.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:54.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:54.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:54.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:54.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:54.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:54.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:54.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:54.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:56.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:56.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:56.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:56.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:56.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:56.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:56.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:56.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:33:56.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:56.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:56.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:56.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:33:56.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:56.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:56.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:56.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:56.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:33:57.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:57.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:33:57.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:57.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:33:57.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:57.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:33:57.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:57.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:33:57.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:57.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:33:57.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:57.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:33:57.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:57.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:33:57.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:57.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:33:57.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:33:57.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:00.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:00.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:00.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:00.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:00.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:00.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:00.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:00.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:00.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:00.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:00.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:00.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:34:00.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:00.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:00.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:00.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:00.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:00.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:00.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:00.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:00.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:00.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:00.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:00.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:02.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:02.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:02.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:02.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:02.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:02.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:02.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:02.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:02.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:02.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:02.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:02.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:02.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:02.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:02.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:02.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:02.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:02.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:02.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:02.978 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:34:04.023 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:34:04.023 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:34:04.077 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2406,"stamp":"2023-09-23T08:34:02.447557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23179263307,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2238241,"num_read_kb":8799034,"num_write":2214820,"num_write_kb":8859651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80484,"ondisk_log_size":80484,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22629404,"kb_used_data":17154668,"kb_used_omap":1370,"kb_used_meta":5473317,"kb_avail":260486116,"statfs":{"total":289910292480,"available":266737782784,"internally_reserved":0,"allocated":17566380032,"data_stored":21707106341,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1403704,"internal_metadata":5604676808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,2,3,6,16,15,12,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7843840,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3724,"num_read_kb":14896,"num_write":3902,"num_write_kb":15608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005997"},"pg_stats":[{"pgid":"2.7","version":"88'274549","reported_seq":540079,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:33:58.576193+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:33:58.576193+0000","last_peered":"2023-09-23T08:33:58.576193+0000","last_clean":"2023-09-23T08:33:58.576193+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:33:58.576193+0000","last_undegraded":"2023-09-23T08:33:58.576193+0000","last_fullsized":"2023-09-23T08:33:58.576193+0000","mapping_epoch":13,"log_start":"85'264511","ondisk_log_start":"85'264511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":517,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 190s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2732171599,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":264902,"num_read_kb":1041454,"num_write":260916,"num_write_kb":1043568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'302617","reported_seq":595538,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:58.525656+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:33:58.525656+0000","last_peered":"2023-09-23T08:33:58.525656+0000","last_clean":"2023-09-23T08:33:58.525656+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:33:58.525656+0000","last_undegraded":"2023-09-23T08:33:58.525656+0000","last_fullsized":"2023-09-23T08:33:58.525656+0000","mapping_epoch":13,"log_start":"85'292607","ondisk_log_start":"85'292607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3051389247,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":293148,"num_read_kb":1148422,"num_write":289343,"num_write_kb":1157141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'286222","reported_seq":561863,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:58.524275+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:33:58.524275+0000","last_peered":"2023-09-23T08:33:58.524275+0000","last_clean":"2023-09-23T08:33:58.524275+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:33:58.524275+0000","last_undegraded":"2023-09-23T08:33:58.524275+0000","last_fullsized":"2023-09-23T08:33:58.524275+0000","mapping_epoch":13,"log_start":"85'276209","ondisk_log_start":"85'276209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2842214700,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":275077,"num_read_kb":1081405,"num_write":272923,"num_write_kb":1091605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'291235","reported_seq":582889,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:33:58.488930+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:33:58.488930+0000","last_peered":"2023-09-23T08:33:58.488930+0000","last_clean":"2023-09-23T08:33:58.488930+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:33:58.488930+0000","last_undegraded":"2023-09-23T08:33:58.488930+0000","last_fullsized":"2023-09-23T08:33:58.488930+0000","mapping_epoch":13,"log_start":"85'281207","ondisk_log_start":"85'281207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":220,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 122s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3040928026,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":292251,"num_read_kb":1154915,"num_write":290307,"num_write_kb":1161141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'284465","reported_seq":567915,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:57.557900+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:33:57.557900+0000","last_peered":"2023-09-23T08:33:57.557900+0000","last_clean":"2023-09-23T08:33:57.557900+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:33:57.557900+0000","last_undegraded":"2023-09-23T08:33:57.557900+0000","last_fullsized":"2023-09-23T08:33:57.557900+0000","mapping_epoch":13,"log_start":"85'274409","ondisk_log_start":"85'274409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2934456638,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":283169,"num_read_kb":1113495,"num_write":281007,"num_write_kb":1123878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'294090","reported_seq":584721,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:33:58.973147+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:33:58.973147+0000","last_peered":"2023-09-23T08:33:58.973147+0000","last_clean":"2023-09-23T08:33:58.973147+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:33:58.973147+0000","last_undegraded":"2023-09-23T08:33:58.973147+0000","last_fullsized":"2023-09-23T08:33:58.973147+0000","mapping_epoch":13,"log_start":"85'284011","ondisk_log_start":"85'284011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":742,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 298s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3023049174,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":290005,"num_read_kb":1139436,"num_write":287647,"num_write_kb":1150468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'269108","reported_seq":535186,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:58.974467+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:33:58.974467+0000","last_peered":"2023-09-23T08:33:58.974467+0000","last_clean":"2023-09-23T08:33:58.974467+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:33:58.974467+0000","last_undegraded":"2023-09-23T08:33:58.974467+0000","last_fullsized":"2023-09-23T08:33:58.974467+0000","mapping_epoch":13,"log_start":"85'259008","ondisk_log_start":"85'259008","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2741547309,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":265289,"num_read_kb":1042365,"num_write":262374,"num_write_kb":1049409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'284267","reported_seq":559230,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:58.529415+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:33:58.529415+0000","last_peered":"2023-09-23T08:33:58.529415+0000","last_clean":"2023-09-23T08:33:58.529415+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:33:58.529415+0000","last_undegraded":"2023-09-23T08:33:58.529415+0000","last_fullsized":"2023-09-23T08:33:58.529415+0000","mapping_epoch":13,"log_start":"85'274206","ondisk_log_start":"85'274206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2812916246,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":274294,"num_read_kb":1077451,"num_write":270166,"num_write_kb":1080547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":262,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:26.293248+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:32:26.293248+0000","last_peered":"2023-09-23T08:32:26.293248+0000","last_clean":"2023-09-23T08:32:26.293248+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:32:26.293248+0000","last_undegraded":"2023-09-23T08:32:26.293248+0000","last_fullsized":"2023-09-23T08:32:26.293248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23178672939,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2238135,"num_read_kb":8798943,"num_write":2214683,"num_write_kb":8857757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17564995584,"data_stored":21705778774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80385,"ondisk_log_size":80385,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5042796,"kb_used_data":3177692,"kb_used_omap":220,"kb_used_meta":1864867,"kb_avail":89329044,"statfs":{"total":96636764160,"available":91472941056,"internally_reserved":0,"allocated":3253956608,"data_stored":4011751838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1909623997},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,1,6,1,6,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:33:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.72599999999999998,"15min":0.77300000000000002},"min":{"1min":0.19400000000000001,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":6.351,"5min":6.351,"15min":10.922000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64300000000000002,"15min":0.78200000000000003},"min":{"1min":0.23599999999999999,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":4.7350000000000003,"5min":6.2009999999999996,"15min":10.954000000000001},"last":0.30199999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:33:16 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.081,"15min":0.99399999999999999},"min":{"1min":0.27200000000000002,"5min":0.23100000000000001,"15min":0.215},"max":{"1min":3.8999999999999999,"5min":6.7629999999999999,"15min":11.65},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.2529999999999999,"15min":1.331},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.182},"max":{"1min":5.3789999999999996,"5min":6.8559999999999999,"15min":14.311999999999999},"last":0.36799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739285,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10268216,"kb_used_data":8576996,"kb_used_omap":733,"kb_used_meta":1690466,"kb_avail":84103624,"statfs":{"total":96636764160,"available":86122110976,"internally_reserved":0,"allocated":8782843904,"data_stored":10853425616,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":751325,"internal_metadata":1731037475},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,3,6,12,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:33:01 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.175,"15min":0.91400000000000003},"min":{"1min":0.248,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":11.917,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":2.2280000000000002,"5min":1.4990000000000001,"15min":1.4930000000000001},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.18099999999999999},"max":{"1min":15.718,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:33:01 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.88600000000000001,"15min":0.95199999999999996},"min":{"1min":0.26600000000000001,"5min":0.23000000000000001,"15min":0.19700000000000001},"max":{"1min":3.948,"5min":10.798999999999999,"15min":26.117000000000001},"last":7.2199999999999998},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.0249999999999999,"15min":0.91300000000000003},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":5.9279999999999999,"5min":11.98,"15min":26.151},"last":0.29699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739292,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7318392,"kb_used_data":5399980,"kb_used_omap":416,"kb_used_meta":1917983,"kb_avail":87053448,"statfs":{"total":96636764160,"available":89142730752,"internally_reserved":0,"allocated":5529579520,"data_stored":6841928887,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":1964015336},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1,2,4,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:33:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.198,"15min":1.222},"min":{"1min":0.188,"5min":0.17299999999999999,"15min":0.17000000000000001},"max":{"1min":7.3330000000000002,"5min":7.3330000000000002,"15min":21.207000000000001},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.302,"15min":1.0620000000000001},"min":{"1min":0.26400000000000001,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":7.3680000000000003,"5min":7.3680000000000003,"15min":20.436},"last":0.314}]},{"osd":2,"last update":"Sat Sep 23 08:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.96099999999999997,"15min":0.80200000000000005},"min":{"1min":0.23100000000000001,"5min":0.193,"15min":0.186},"max":{"1min":1.802,"5min":12.529,"15min":15.039999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.76700000000000002,"15min":0.82299999999999995},"min":{"1min":0.27200000000000002,"5min":0.184,"15min":0.184},"max":{"1min":0.57599999999999996,"5min":12.388,"15min":21.757999999999999},"last":0.27900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5528801280,"data_stored":6841050642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8782680064,"data_stored":10853034795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3253514240,"data_stored":4011693337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:34:04.079 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:04.079 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:04.079 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:04.079 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:04.079 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:04.080 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-09-23T08:34:04.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:04.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:04.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:04.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:04.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:04.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:04.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:04.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:04.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:04.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:04.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:04.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:05.151 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-09-23T08:34:05.224 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-09-23T08:34:06.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:06.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:06.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:06.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:06.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:06.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:06.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:06.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:06.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:06.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:06.240 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-09-23T08:34:06.306 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-09-23T08:34:06.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:06.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:06.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:06.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:06.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:06.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:06.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:06.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:06.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:06.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:06.947 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-09-23T08:34:06.980 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-09-23T08:34:07.803 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-09-23T08:34:07.858 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-09-23T08:34:08.671 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-09-23T08:34:08.751 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:34:11.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:11.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:11.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:11.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:11.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:11.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:11.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:11.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:11.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:11.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:11.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:11.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:11.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:11.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:11.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:11.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:11.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:11.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:14.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:14.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:14.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:14.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:14.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:14.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:14.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:14.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:14.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:14.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:14.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:14.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:14.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:14.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:14.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:14.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:14.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:14.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:15.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:15.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:15.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:15.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:15.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:15.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:15.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:15.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:15.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:15.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:15.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:15.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:17.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:17.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:17.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:17.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:17.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:17.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:17.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:17.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:17.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:17.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:17.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:17.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:17.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:17.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:17.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:17.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:17.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:17.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:17.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:17.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:18.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:18.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:18.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:18.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:18.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:18.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:18.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:18.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:18.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:18.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:18.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:18.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:18.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:18.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:18.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:18.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:18.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:18.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:18.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:18.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:18.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:18.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:18.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:18.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:18.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:18.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:18.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:18.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:18.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:18.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:20.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:20.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:20.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:20.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:20.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:20.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:20.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:20.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:20.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:20.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:20.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:20.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:20.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:20.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:20.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:20.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:20.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:20.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:20.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:20.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:22.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:22.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:22.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:22.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:22.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:22.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:22.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:22.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:22.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:22.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:22.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:22.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:22.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:22.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:23.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:23.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:23.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:23.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:24.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:24.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:24.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:24.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:24.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:24.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:24.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:24.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:24.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:24.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:24.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:24.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:24.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:24.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:24.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:24.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:25.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:25.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:25.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:25.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:25.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:25.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:25.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:25.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:25.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:25.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:25.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:25.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:25.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:25.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:25.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:25.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:25.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:25.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:26.571 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:34:26.566+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:34:28.752 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:34:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:34:29.507 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:34:29.547 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2419,"stamp":"2023-09-23T08:34:28.460221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23199935819,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2248063,"num_read_kb":8838322,"num_write":2224737,"num_write_kb":8899319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80589,"ondisk_log_size":80589,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23029276,"kb_used_data":17203328,"kb_used_omap":1370,"kb_used_meta":5824549,"kb_avail":260086244,"statfs":{"total":289910292480,"available":266328313856,"internally_reserved":0,"allocated":17616207872,"data_stored":21750056997,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1403704,"internal_metadata":5964338376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,1,4,6,7,9,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8851456,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4026,"num_read_kb":16104,"num_write":4148,"num_write_kb":16592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001953"},"pg_stats":[{"pgid":"2.7","version":"88'275795","reported_seq":542403,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:34:24.229095+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:34:24.229095+0000","last_peered":"2023-09-23T08:34:24.229095+0000","last_clean":"2023-09-23T08:34:24.229095+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:34:24.229095+0000","last_undegraded":"2023-09-23T08:34:24.229095+0000","last_fullsized":"2023-09-23T08:34:24.229095+0000","mapping_epoch":13,"log_start":"85'265711","ondisk_log_start":"85'265711","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":582,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 216s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2734530895,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":265957,"num_read_kb":1045674,"num_write":262072,"num_write_kb":1048192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'303939","reported_seq":598101,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:24.222198+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:34:24.222198+0000","last_peered":"2023-09-23T08:34:24.222198+0000","last_clean":"2023-09-23T08:34:24.222198+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:34:24.222198+0000","last_undegraded":"2023-09-23T08:34:24.222198+0000","last_fullsized":"2023-09-23T08:34:24.222198+0000","mapping_epoch":13,"log_start":"86'293907","ondisk_log_start":"86'293907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3054051647,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":294373,"num_read_kb":1153322,"num_write":290611,"num_write_kb":1162213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'287501","reported_seq":564341,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:24.225478+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:34:24.225478+0000","last_peered":"2023-09-23T08:34:24.225478+0000","last_clean":"2023-09-23T08:34:24.225478+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:34:24.225478+0000","last_undegraded":"2023-09-23T08:34:24.225478+0000","last_fullsized":"2023-09-23T08:34:24.225478+0000","mapping_epoch":13,"log_start":"85'277409","ondisk_log_start":"85'277409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2844762412,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":276262,"num_read_kb":1086145,"num_write":274148,"num_write_kb":1096505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'292562","reported_seq":585448,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:34:24.161358+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:34:24.161358+0000","last_peered":"2023-09-23T08:34:24.161358+0000","last_clean":"2023-09-23T08:34:24.161358+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:34:24.161358+0000","last_undegraded":"2023-09-23T08:34:24.161358+0000","last_fullsized":"2023-09-23T08:34:24.161358+0000","mapping_epoch":13,"log_start":"85'282507","ondisk_log_start":"85'282507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":280,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 148s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3043582234,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":293469,"num_read_kb":1159787,"num_write":291595,"num_write_kb":1166293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'285977","reported_seq":570935,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:28.009194+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:34:28.009194+0000","last_peered":"2023-09-23T08:34:28.009194+0000","last_clean":"2023-09-23T08:34:28.009194+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:34:28.009194+0000","last_undegraded":"2023-09-23T08:34:28.009194+0000","last_fullsized":"2023-09-23T08:34:28.009194+0000","mapping_epoch":13,"log_start":"85'275909","ondisk_log_start":"85'275909","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2937606462,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":284665,"num_read_kb":1119479,"num_write":282509,"num_write_kb":1129886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'295376","reported_seq":587315,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:34:24.312934+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:34:24.312934+0000","last_peered":"2023-09-23T08:34:24.312934+0000","last_clean":"2023-09-23T08:34:24.312934+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:34:24.312934+0000","last_undegraded":"2023-09-23T08:34:24.312934+0000","last_fullsized":"2023-09-23T08:34:24.312934+0000","mapping_epoch":13,"log_start":"86'285311","ondisk_log_start":"86'285311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":831,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 323s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3025617366,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":291284,"num_read_kb":1144552,"num_write":288861,"num_write_kb":1155324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'270233","reported_seq":537488,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:24.325082+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:34:24.325082+0000","last_peered":"2023-09-23T08:34:24.325082+0000","last_clean":"2023-09-23T08:34:24.325082+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:34:24.325082+0000","last_undegraded":"2023-09-23T08:34:24.325082+0000","last_fullsized":"2023-09-23T08:34:24.325082+0000","mapping_epoch":13,"log_start":"85'260208","ondisk_log_start":"85'260208","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2743898413,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":266452,"num_read_kb":1047017,"num_write":263481,"num_write_kb":1053837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'285475","reported_seq":561655,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:24.189643+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:34:24.189643+0000","last_peered":"2023-09-23T08:34:24.189643+0000","last_clean":"2023-09-23T08:34:24.189643+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:34:24.189643+0000","last_undegraded":"2023-09-23T08:34:24.189643+0000","last_fullsized":"2023-09-23T08:34:24.189643+0000","mapping_epoch":13,"log_start":"85'275406","ondisk_log_start":"85'275406","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2815296022,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":275495,"num_read_kb":1082255,"num_write":271323,"num_write_kb":1085175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":262,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-09-23T08:32:26.293248+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:32:26.293248+0000","last_peered":"2023-09-23T08:32:26.293248+0000","last_clean":"2023-09-23T08:32:26.293248+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:32:26.293248+0000","last_undegraded":"2023-09-23T08:32:26.293248+0000","last_fullsized":"2023-09-23T08:32:26.293248+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23199345451,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2247957,"num_read_kb":8838231,"num_write":2224600,"num_write_kb":8897425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17614090240,"data_stored":21748151894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80490,"ondisk_log_size":80490,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739302,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5092424,"kb_used_data":3186048,"kb_used_omap":220,"kb_used_meta":1906147,"kb_avail":89279416,"statfs":{"total":96636764160,"available":91422121984,"internally_reserved":0,"allocated":3262513152,"data_stored":4019227038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":226115,"internal_metadata":1951894717},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,3,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:34:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":0.91100000000000003,"15min":0.83599999999999997},"min":{"1min":0.246,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":6.4260000000000002,"5min":6.4260000000000002,"15min":10.922000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.71299999999999997,"15min":0.79000000000000004},"min":{"1min":0.23899999999999999,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":10.954000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Sep 23 08:34:20 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.2210000000000001,"15min":1.073},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":9.5709999999999997,"5min":9.5709999999999997,"15min":11.65},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.272,"15min":1.377},"min":{"1min":0.23300000000000001,"5min":0.20399999999999999,"15min":0.182},"max":{"1min":5.4580000000000002,"5min":6.8559999999999999,"15min":14.311999999999999},"last":0.59099999999999997}]}]},{"osd":1,"up_from":8,"seq":34359739290,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10461112,"kb_used_data":8600108,"kb_used_omap":733,"kb_used_meta":1860258,"kb_avail":83910728,"statfs":{"total":96636764160,"available":85924585472,"internally_reserved":0,"allocated":8806510592,"data_stored":10873807312,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":751325,"internal_metadata":1904904483},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,0,3,6,4,4,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":1.0169999999999999,"15min":0.89700000000000002},"min":{"1min":0.24199999999999999,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":4.0149999999999997,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.4299999999999999,"15min":1.48},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":2.1440000000000001,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.24199999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:34:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.056,"15min":1.0009999999999999},"min":{"1min":0.25900000000000001,"5min":0.23400000000000001,"15min":0.19700000000000001},"max":{"1min":7.2199999999999998,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.307},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.98199999999999998,"15min":0.92500000000000004},"min":{"1min":0.24399999999999999,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":4.2779999999999996,"5min":11.98,"15min":26.151},"last":0.441}]}]},{"osd":0,"up_from":8,"seq":34359739298,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7475740,"kb_used_data":5417172,"kb_used_omap":416,"kb_used_meta":2058143,"kb_avail":86896100,"statfs":{"total":96636764160,"available":88981606400,"internally_reserved":0,"allocated":5547184128,"data_stored":6857022647,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":2107539176},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,1,0,3,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:34:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3029999999999999,"15min":1.244},"min":{"1min":0.22600000000000001,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":7.2300000000000004,"5min":7.3330000000000002,"15min":21.207000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4059999999999999,"15min":1.1140000000000001},"min":{"1min":0.314,"5min":0.25600000000000001,"15min":0.20300000000000001},"max":{"1min":7.266,"5min":7.3680000000000003,"15min":20.436},"last":0.40200000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.96099999999999997,"15min":0.80200000000000005},"min":{"1min":0.23100000000000001,"5min":0.193,"15min":0.186},"max":{"1min":1.802,"5min":12.529,"15min":15.039999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.76700000000000002,"15min":0.82299999999999995},"min":{"1min":0.27200000000000002,"5min":0.184,"15min":0.184},"max":{"1min":0.57599999999999996,"5min":12.388,"15min":21.757999999999999},"last":0.372}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5546409984,"data_stored":6856144402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8805834752,"data_stored":10873027371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3261845504,"data_stored":4018980121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:34:29.548 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:29.549 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:29.549 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:29.549 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:29.549 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:29.549 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:34:30.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:30.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:30.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:30.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:30.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:30.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:30.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:30.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:30.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:30.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:30.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:30.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.198+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:34:30.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:30.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:30.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:30.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:30.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:30.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:30.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:30.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:30.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:30.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:30.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:30.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:32.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:32.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:32.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:32.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:32.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:32.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:32.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:32.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:32.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:32.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:32.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:32.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:32.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:32.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:32.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:32.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:32.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:32.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:33.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:33.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:33.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:33.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:33.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:33.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:33.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:33.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:33.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:33.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:33.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:33.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:34.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:34.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:34.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:34.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:34.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:34.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:34.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:34.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:34.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:34.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:34.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:34.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:34.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:34.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:34.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:34.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:34.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:34.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:34.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:34.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:35.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:35.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:35.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:35.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:35.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:35.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:35.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:35.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:35.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:35.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:35.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:35.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:35.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:35.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:35.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:35.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:35.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:35.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:35.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:36.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:36.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:36.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:36.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:36.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:36.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:36.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:36.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:36.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:36.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:36.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:36.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:36.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:36.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:36.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:36.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:36.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:36.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:36.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:36.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:39.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:39.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:39.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:39.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:39.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:39.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:39.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:39.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:39.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:39.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:39.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:39.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:39.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:39.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:39.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:39.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:40.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:40.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:40.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:40.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:40.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:40.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:40.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:40.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:40.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:40.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:40.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:40.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:41.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:41.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:41.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:41.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:41.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:41.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:41.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:41.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:41.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:41.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:41.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:41.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:41.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:41.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:41.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:41.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:41.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:41.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:44.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:34:44.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:44.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:44.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:44.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:44.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:44.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:44.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:44.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:44.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:44.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:44.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:44.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:45.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:45.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:45.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:45.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:45.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:45.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:45.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:45.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:45.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:45.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:45.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:45.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:45.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:45.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:45.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:45.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:45.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:45.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:45.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:45.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:46.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:46.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:46.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:46.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:46.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:46.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:46.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:46.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:46.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:46.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:47.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:47.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:47.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:47.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:47.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:47.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:47.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:47.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:47.668 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:34:47.665+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:34:47.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:47.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:47.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:47.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:47.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:47.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:47.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:47.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:47.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:47.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:49.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:49.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:49.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:49.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:49.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:49.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:49.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:49.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:49.273 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:34:49.269+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:34:49.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:49.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:49.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:49.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:49.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:49.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:49.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:49.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:49.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:49.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:49.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:49.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:49.550 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:34:50.325 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:34:50.326 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:34:50.371 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2429,"stamp":"2023-09-23T08:34:48.468487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23216827723,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2255673,"num_read_kb":8868762,"num_write":2232539,"num_write_kb":8930527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80573,"ondisk_log_size":80573,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22245080,"kb_used_data":17240500,"kb_used_omap":1469,"kb_used_meta":5003074,"kb_avail":260870440,"statfs":{"total":289910292480,"available":267131330560,"internally_reserved":0,"allocated":17654272000,"data_stored":21782911013,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1505033,"internal_metadata":5123148023},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,4,1,3,15,11,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9105408,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4147,"num_read_kb":16588,"num_write":4166,"num_write_kb":16664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007053"},"pg_stats":[{"pgid":"2.7","version":"88'276818","reported_seq":544327,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:34:44.709941+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:34:44.709941+0000","last_peered":"2023-09-23T08:34:44.709941+0000","last_clean":"2023-09-23T08:34:44.709941+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:34:44.709941+0000","last_undegraded":"2023-09-23T08:34:44.709941+0000","last_fullsized":"2023-09-23T08:34:44.709941+0000","mapping_epoch":13,"log_start":"86'266811","ondisk_log_start":"86'266811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":635,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 236s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2736644431,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":266833,"num_read_kb":1049178,"num_write":263017,"num_write_kb":1051972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'304959","reported_seq":600127,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:44.695813+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:34:44.695813+0000","last_peered":"2023-09-23T08:34:44.695813+0000","last_clean":"2023-09-23T08:34:44.695813+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:34:44.695813+0000","last_undegraded":"2023-09-23T08:34:44.695813+0000","last_fullsized":"2023-09-23T08:34:44.695813+0000","mapping_epoch":13,"log_start":"86'294907","ondisk_log_start":"86'294907","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3056271679,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":295368,"num_read_kb":1157302,"num_write":291586,"num_write_kb":1166113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'288523","reported_seq":566294,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:44.690172+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:34:44.690172+0000","last_peered":"2023-09-23T08:34:44.690172+0000","last_clean":"2023-09-23T08:34:44.690172+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:34:44.690172+0000","last_undegraded":"2023-09-23T08:34:44.690172+0000","last_fullsized":"2023-09-23T08:34:44.690172+0000","mapping_epoch":13,"log_start":"86'278509","ondisk_log_start":"86'278509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2846826796,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":277179,"num_read_kb":1089813,"num_write":275125,"num_write_kb":1100413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'293591","reported_seq":587516,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:34:44.704560+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:34:44.704560+0000","last_peered":"2023-09-23T08:34:44.704560+0000","last_clean":"2023-09-23T08:34:44.704560+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:34:44.704560+0000","last_undegraded":"2023-09-23T08:34:44.704560+0000","last_fullsized":"2023-09-23T08:34:44.704560+0000","mapping_epoch":13,"log_start":"86'283507","ondisk_log_start":"86'283507","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":311,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 168s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3045720346,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":294497,"num_read_kb":1163899,"num_write":292603,"num_write_kb":1170325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'286968","reported_seq":572912,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:48.120307+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:34:48.120307+0000","last_peered":"2023-09-23T08:34:48.120307+0000","last_clean":"2023-09-23T08:34:48.120307+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:34:48.120307+0000","last_undegraded":"2023-09-23T08:34:48.120307+0000","last_fullsized":"2023-09-23T08:34:48.120307+0000","mapping_epoch":13,"log_start":"86'276909","ondisk_log_start":"86'276909","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2939777342,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":285643,"num_read_kb":1123391,"num_write":283496,"num_write_kb":1133834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'296393","reported_seq":589323,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:34:44.555578+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:34:44.555578+0000","last_peered":"2023-09-23T08:34:44.555578+0000","last_clean":"2023-09-23T08:34:44.555578+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:34:44.555578+0000","last_undegraded":"2023-09-23T08:34:44.555578+0000","last_fullsized":"2023-09-23T08:34:44.555578+0000","mapping_epoch":13,"log_start":"86'286311","ondisk_log_start":"86'286311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":874,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 344s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3027730902,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":292255,"num_read_kb":1148436,"num_write":289843,"num_write_kb":1159252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'271198","reported_seq":539344,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:44.568277+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:34:44.568277+0000","last_peered":"2023-09-23T08:34:44.568277+0000","last_clean":"2023-09-23T08:34:44.568277+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:34:44.568277+0000","last_undegraded":"2023-09-23T08:34:44.568277+0000","last_fullsized":"2023-09-23T08:34:44.568277+0000","mapping_epoch":13,"log_start":"86'261108","ondisk_log_start":"86'261108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2745925933,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":267331,"num_read_kb":1050533,"num_write":264437,"num_write_kb":1057661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'286492","reported_seq":563650,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:44.686639+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:34:44.686639+0000","last_peered":"2023-09-23T08:34:44.686639+0000","last_clean":"2023-09-23T08:34:44.686639+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:34:44.686639+0000","last_undegraded":"2023-09-23T08:34:44.686639+0000","last_fullsized":"2023-09-23T08:34:44.686639+0000","mapping_epoch":13,"log_start":"86'276406","ondisk_log_start":"86'276406","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2817339926,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":276461,"num_read_kb":1086119,"num_write":272295,"num_write_kb":1089063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":263,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:32.168703+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:33:32.168703+0000","last_peered":"2023-09-23T08:33:32.168703+0000","last_clean":"2023-09-23T08:33:32.168703+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:33:32.168703+0000","last_undegraded":"2023-09-23T08:33:32.168703+0000","last_fullsized":"2023-09-23T08:33:32.168703+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23216237355,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2255567,"num_read_kb":8868671,"num_write":2232402,"num_write_kb":8928633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17652658176,"data_stored":21781444182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80474,"ondisk_log_size":80474,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739306,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4626268,"kb_used_data":3192916,"kb_used_omap":319,"kb_used_meta":1433024,"kb_avail":89745572,"statfs":{"total":96636764160,"available":91899465728,"internally_reserved":0,"allocated":3269545984,"data_stored":4025338270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1467416812},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:34:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":0.91100000000000003,"15min":0.83599999999999997},"min":{"1min":0.246,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":6.4260000000000002,"5min":6.4260000000000002,"15min":10.922000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.71299999999999997,"15min":0.79000000000000004},"min":{"1min":0.23899999999999999,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":10.954000000000001},"last":0.38}]},{"osd":1,"last update":"Sat Sep 23 08:34:20 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.2210000000000001,"15min":1.073},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":9.5709999999999997,"5min":9.5709999999999997,"15min":11.65},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.272,"15min":1.377},"min":{"1min":0.23300000000000001,"5min":0.20399999999999999,"15min":0.182},"max":{"1min":5.4580000000000002,"5min":6.8559999999999999,"15min":14.311999999999999},"last":0.27200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739294,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10592060,"kb_used_data":8618608,"kb_used_omap":733,"kb_used_meta":1972706,"kb_avail":83779780,"statfs":{"total":96636764160,"available":85790494720,"internally_reserved":0,"allocated":8825454592,"data_stored":10890174928,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":751325,"internal_metadata":2020051235},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,1,11,8,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":1.0169999999999999,"15min":0.89700000000000002},"min":{"1min":0.24199999999999999,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":4.0149999999999997,"5min":21.216000000000001,"15min":21.216000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.4299999999999999,"15min":1.48},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":2.1440000000000001,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.23100000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:34:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.056,"15min":1.0009999999999999},"min":{"1min":0.25900000000000001,"5min":0.23400000000000001,"15min":0.19700000000000001},"max":{"1min":7.2199999999999998,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.98199999999999998,"15min":0.92500000000000004},"min":{"1min":0.24399999999999999,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":4.2779999999999996,"5min":11.98,"15min":26.151},"last":0.32600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739302,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7026752,"kb_used_data":5428976,"kb_used_omap":416,"kb_used_meta":1597343,"kb_avail":87345088,"statfs":{"total":96636764160,"available":89441370112,"internally_reserved":0,"allocated":5559271424,"data_stored":6867397815,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":1635679976},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,1,2,2,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:34:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3029999999999999,"15min":1.244},"min":{"1min":0.22600000000000001,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":7.2300000000000004,"5min":7.3330000000000002,"15min":21.207000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4059999999999999,"15min":1.1140000000000001},"min":{"1min":0.314,"5min":0.25600000000000001,"15min":0.20300000000000001},"max":{"1min":7.266,"5min":7.3680000000000003,"15min":20.436},"last":0.88300000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.96099999999999997,"15min":0.80200000000000005},"min":{"1min":0.23100000000000001,"5min":0.193,"15min":0.186},"max":{"1min":1.802,"5min":12.529,"15min":15.039999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.76700000000000002,"15min":0.82299999999999995},"min":{"1min":0.27200000000000002,"5min":0.184,"15min":0.184},"max":{"1min":0.57599999999999996,"5min":12.388,"15min":21.757999999999999},"last":0.81899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5558493184,"data_stored":6866519570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8825253888,"data_stored":10889800491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3268911104,"data_stored":4025124121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:34:50.373 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:50.373 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:50.374 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:50.374 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:50.374 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:34:50.374 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:34:51.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:51.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:51.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:51.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:51.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:51.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:51.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:51.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:51.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:51.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:51.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:51.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:51.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:51.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:51.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:51.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:51.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:51.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:51.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:52.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:52.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:52.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:52.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:52.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:52.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:52.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:52.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:52.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:52.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:52.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:52.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:52.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:52.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:52.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:52.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:52.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:52.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:52.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:52.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:53.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:34:53.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:53.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:34:53.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:53.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:53.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:53.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:53.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:53.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:53.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:53.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:53.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:53.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:53.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:53.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:53.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:53.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:55.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:55.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:55.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:55.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:55.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:55.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:55.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:55.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:55.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:55.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:34:55.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:55.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:55.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:55.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:55.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:55.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:55.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:55.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:55.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:55.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:34:59.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:59.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:34:59.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:59.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:34:59.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:59.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:34:59.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:59.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:34:59.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:59.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:34:59.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:59.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:34:59.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:59.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:34:59.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:59.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:34:59.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:34:59.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:02.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:02.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:02.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:02.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:02.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:02.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:03.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:03.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:03.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:03.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:03.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:03.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:03.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:03.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:03.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:03.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:03.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:03.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:03.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:03.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:03.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:03.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:03.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:03.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:03.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:03.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:03.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:03.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:03.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:03.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:03.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:03.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:03.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:03.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:03.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:03.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:03.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:03.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:03.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:03.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:03.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:03.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:03.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:03.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:03.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:03.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:03.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:05.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:35:05.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:05.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:05.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:05.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:05.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:05.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:05.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:05.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:05.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:05.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:05.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:05.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:05.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:05.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:05.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:05.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:05.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:05.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:05.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:05.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:05.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:05.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:05.843 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:05.849 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:05.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:05.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:05.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:05.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:05.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:05.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:05.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:05.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:05.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:05.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:06.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:06.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:06.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:06.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:06.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:06.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:06.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:06.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:06.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:06.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:06.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:06.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:06.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:06.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:07.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:35:07.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:07.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:07.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:07.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:07.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:07.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:07.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:07.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:07.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:07.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:07.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:07.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:07.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:07.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:07.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:07.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:07.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:07.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:07.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:07.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:07.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:07.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:08.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:08.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:08.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:08.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:08.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:08.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:08.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:08.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:08.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:08.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:08.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:08.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:10.375 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:35:10.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:10.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:10.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:10.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:10.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:10.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:10.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:10.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:10.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:10.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:10.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:10.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:35:11.100 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:35:11.195 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2440,"stamp":"2023-09-23T08:35:10.476505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23234379083,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2263923,"num_read_kb":8901762,"num_write":2240821,"num_write_kb":8963655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80346,"ondisk_log_size":80346,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22606488,"kb_used_data":17279352,"kb_used_omap":1469,"kb_used_meta":5325634,"kb_avail":260509032,"statfs":{"total":289910292480,"available":266761248768,"internally_reserved":0,"allocated":17694056448,"data_stored":21816846373,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1505033,"internal_metadata":5453449463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,9,10,20,10,10,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9265152,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4336,"num_read_kb":17344,"num_write":4407,"num_write_kb":17628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001995"},"pg_stats":[{"pgid":"2.7","version":"88'277825","reported_seq":546310,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:35:05.420709+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:35:05.420709+0000","last_peered":"2023-09-23T08:35:05.420709+0000","last_clean":"2023-09-23T08:35:05.420709+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:35:05.420709+0000","last_undegraded":"2023-09-23T08:35:05.420709+0000","last_fullsized":"2023-09-23T08:35:05.420709+0000","mapping_epoch":13,"log_start":"86'267811","ondisk_log_start":"86'267811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":678,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 257s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2738467151,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":267788,"num_read_kb":1052998,"num_write":263938,"num_write_kb":1055656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'306083","reported_seq":602235,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:05.330725+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:35:05.330725+0000","last_peered":"2023-09-23T08:35:05.330725+0000","last_clean":"2023-09-23T08:35:05.330725+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:35:05.330725+0000","last_undegraded":"2023-09-23T08:35:05.330725+0000","last_fullsized":"2023-09-23T08:35:05.330725+0000","mapping_epoch":13,"log_start":"86'296007","ondisk_log_start":"86'296007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3058495807,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":296339,"num_read_kb":1161186,"num_write":292656,"num_write_kb":1170393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'289534","reported_seq":568256,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:05.429103+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:35:05.429103+0000","last_peered":"2023-09-23T08:35:05.429103+0000","last_clean":"2023-09-23T08:35:05.429103+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:35:05.429103+0000","last_undegraded":"2023-09-23T08:35:05.429103+0000","last_fullsized":"2023-09-23T08:35:05.429103+0000","mapping_epoch":13,"log_start":"86'279509","ondisk_log_start":"86'279509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2848940332,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":278118,"num_read_kb":1093569,"num_write":276079,"num_write_kb":1104229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'294665","reported_seq":589659,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:35:05.409373+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:35:05.409373+0000","last_peered":"2023-09-23T08:35:05.409373+0000","last_clean":"2023-09-23T08:35:05.409373+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:35:05.409373+0000","last_undegraded":"2023-09-23T08:35:05.409373+0000","last_fullsized":"2023-09-23T08:35:05.409373+0000","mapping_epoch":13,"log_start":"86'284607","ondisk_log_start":"86'284607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":355,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 189s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3048026394,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":295560,"num_read_kb":1168151,"num_write":293647,"num_write_kb":1174501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'287933","reported_seq":574863,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:08.255645+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:35:08.255645+0000","last_peered":"2023-09-23T08:35:08.255645+0000","last_clean":"2023-09-23T08:35:08.255645+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:35:08.255645+0000","last_undegraded":"2023-09-23T08:35:08.255645+0000","last_fullsized":"2023-09-23T08:35:08.255645+0000","mapping_epoch":13,"log_start":"86'277909","ondisk_log_start":"86'277909","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2941825342,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":286620,"num_read_kb":1127299,"num_write":284455,"num_write_kb":1137670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'297728","reported_seq":591917,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:35:09.816143+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:35:09.816143+0000","last_peered":"2023-09-23T08:35:09.816143+0000","last_clean":"2023-09-23T08:35:09.816143+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:35:09.816143+0000","last_undegraded":"2023-09-23T08:35:09.816143+0000","last_fullsized":"2023-09-23T08:35:09.816143+0000","mapping_epoch":13,"log_start":"86'287711","ondisk_log_start":"86'287711","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":942,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 369s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3030381014,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":293483,"num_read_kb":1153348,"num_write":291107,"num_write_kb":1164308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'272314","reported_seq":541666,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:09.822061+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:35:09.822061+0000","last_peered":"2023-09-23T08:35:09.822061+0000","last_clean":"2023-09-23T08:35:09.822061+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:35:09.822061+0000","last_undegraded":"2023-09-23T08:35:09.822061+0000","last_fullsized":"2023-09-23T08:35:09.822061+0000","mapping_epoch":13,"log_start":"86'262308","ondisk_log_start":"86'262308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2748236077,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":268521,"num_read_kb":1055293,"num_write":265523,"num_write_kb":1062005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'287533","reported_seq":565628,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:05.399522+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:35:05.399522+0000","last_peered":"2023-09-23T08:35:05.399522+0000","last_clean":"2023-09-23T08:35:05.399522+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:35:05.399522+0000","last_undegraded":"2023-09-23T08:35:05.399522+0000","last_fullsized":"2023-09-23T08:35:05.399522+0000","mapping_epoch":13,"log_start":"86'277506","ondisk_log_start":"86'277506","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2819416598,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":277388,"num_read_kb":1089827,"num_write":273279,"num_write_kb":1092999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":263,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:32.168703+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:33:32.168703+0000","last_peered":"2023-09-23T08:33:32.168703+0000","last_clean":"2023-09-23T08:33:32.168703+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:33:32.168703+0000","last_undegraded":"2023-09-23T08:33:32.168703+0000","last_fullsized":"2023-09-23T08:33:32.168703+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23233788715,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2263817,"num_read_kb":8901671,"num_write":2240684,"num_write_kb":8961761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17692180480,"data_stored":21815121494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80247,"ondisk_log_size":80247,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739311,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4701288,"kb_used_data":3201308,"kb_used_omap":319,"kb_used_meta":1499648,"kb_avail":89670552,"statfs":{"total":96636764160,"available":91822645248,"internally_reserved":0,"allocated":3278139392,"data_stored":4032706974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1535639788},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5,0,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:34:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":0.91100000000000003,"15min":0.83599999999999997},"min":{"1min":0.246,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":6.4260000000000002,"5min":6.4260000000000002,"15min":10.922000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.71299999999999997,"15min":0.79000000000000004},"min":{"1min":0.23899999999999999,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":10.954000000000001},"last":0.501}]},{"osd":1,"last update":"Sat Sep 23 08:34:20 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.2210000000000001,"15min":1.073},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":9.5709999999999997,"5min":9.5709999999999997,"15min":11.65},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.272,"15min":1.377},"min":{"1min":0.23300000000000001,"5min":0.20399999999999999,"15min":0.182},"max":{"1min":5.4580000000000002,"5min":6.8559999999999999,"15min":14.311999999999999},"last":0.54500000000000004}]}]},{"osd":1,"up_from":8,"seq":34359739298,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10772848,"kb_used_data":8637800,"kb_used_omap":733,"kb_used_meta":2134306,"kb_avail":83598992,"statfs":{"total":96636764160,"available":85605367808,"internally_reserved":0,"allocated":8845107200,"data_stored":10906980816,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":751325,"internal_metadata":2185529635},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,6,5,10,9,6,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.76000000000000001,"15min":0.88100000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":3.1589999999999998,"5min":11.917,"15min":21.216000000000001},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":1.1279999999999999,"15min":1.4830000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":4.0960000000000001,"5min":15.718,"15min":21.388999999999999},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.96199999999999997,"15min":1.0149999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.19700000000000001},"max":{"1min":3.1989999999999998,"5min":10.798999999999999,"15min":26.117000000000001},"last":2.6179999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.81000000000000005,"15min":0.95199999999999996},"min":{"1min":0.251,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":7.8170000000000002,"5min":7.8170000000000002,"15min":26.151},"last":0.59699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739306,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7132352,"kb_used_data":5440244,"kb_used_omap":416,"kb_used_meta":1691679,"kb_avail":87239488,"statfs":{"total":96636764160,"available":89333235712,"internally_reserved":0,"allocated":5570809856,"data_stored":6877158583,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":1732280040},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,0,10],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:34:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3029999999999999,"15min":1.244},"min":{"1min":0.22600000000000001,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":7.2300000000000004,"5min":7.3330000000000002,"15min":21.207000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4059999999999999,"15min":1.1140000000000001},"min":{"1min":0.314,"5min":0.25600000000000001,"15min":0.20300000000000001},"max":{"1min":7.266,"5min":7.3680000000000003,"15min":20.436},"last":0.78800000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:34:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.249,"5min":0.193,"15min":0.193},"max":{"1min":5.9390000000000001,"5min":6.9809999999999999,"15min":15.039999999999999},"last":0.443},{"interface":"front","average":{"1min":0.377,"5min":0.64800000000000002,"15min":0.81000000000000005},"min":{"1min":0.22800000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.81899999999999995,"5min":7.0410000000000004,"15min":21.757999999999999},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5570072576,"data_stored":6876309010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8844599296,"data_stored":10906315563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3277508608,"data_stored":4032496921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:35:11.196 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:11.197 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:11.197 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:11.197 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:11.197 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:11.198 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:35:12.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:12.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:12.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:12.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:12.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:12.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:12.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:12.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:12.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:12.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:12.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:12.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:13.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:13.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:13.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:13.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:13.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:13.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:13.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:13.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:13.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:13.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:13.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:13.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:18.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:18.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:18.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:18.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:18.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:18.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:18.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:18.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:18.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:18.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:18.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:18.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:18.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:18.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:18.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:20.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:20.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:20.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:20.689 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:20.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:20.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:20.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:20.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:20.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:20.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:20.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:20.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:20.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:20.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:20.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:20.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:20.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:21.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:21.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:21.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:21.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:21.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:21.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:21.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:21.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:35:21.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:21.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:21.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:21.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:21.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:21.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:21.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:21.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:21.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:21.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:21.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:21.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:21.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:21.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:22.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:22.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:22.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:22.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:22.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:22.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:22.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:22.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:23.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:22.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:23.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:22.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:23.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:22.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:23.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:22.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:23.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:23.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:25.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:25.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:25.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:25.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:25.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:25.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:25.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:25.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:25.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:25.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:25.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:25.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:25.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:25.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:25.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:25.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:25.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:25.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:25.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:25.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:27.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:27.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:27.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:27.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:27.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:27.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:27.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:27.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:27.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:27.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:27.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:27.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:27.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:27.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:27.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:27.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:27.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:27.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:27.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:27.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:28.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:28.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:28.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:28.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:28.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:28.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:28.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:28.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:28.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:28.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:30.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:30.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:30.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:30.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:30.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:30.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:30.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:30.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:30.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:30.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:30.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:30.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:31.199 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:35:31.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:35:31.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:31.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:31.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:31.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:31.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:31.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:31.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:31.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:31.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:31.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:31.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:31.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:35:31.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:31.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:31.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:31.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:31.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:31.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:31.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:31.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:31.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:31.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:31.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:31.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:32.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:32.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:32.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:32.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:32.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:32.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:32.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:32.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:32.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:32.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:32.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:32.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:32.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:32.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:32.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:32.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:32.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:32.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:32.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:32.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:32.217 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:35:32.218 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:35:32.293 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2450,"stamp":"2023-09-23T08:35:30.479495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23250533707,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2271928,"num_read_kb":8933782,"num_write":2248741,"num_write_kb":8995335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80470,"ondisk_log_size":80470,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22574964,"kb_used_data":17314836,"kb_used_omap":1469,"kb_used_meta":5258626,"kb_avail":260540556,"statfs":{"total":289910292480,"available":266793529344,"internally_reserved":0,"allocated":17730392064,"data_stored":21847447589,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1505033,"internal_metadata":5384833271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,6,4,12,8,24,13,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8990720,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4399,"num_read_kb":17596,"num_write":4427,"num_write_kb":17708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001739"},"pg_stats":[{"pgid":"2.7","version":"88'278872","reported_seq":548274,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:35:26.052250+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:35:26.052250+0000","last_peered":"2023-09-23T08:35:26.052250+0000","last_clean":"2023-09-23T08:35:26.052250+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:35:26.052250+0000","last_undegraded":"2023-09-23T08:35:26.052250+0000","last_fullsized":"2023-09-23T08:35:26.052250+0000","mapping_epoch":13,"log_start":"86'268811","ondisk_log_start":"86'268811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":760,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 278s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2740531535,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":268690,"num_read_kb":1056606,"num_write":264877,"num_write_kb":1059412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'307196","reported_seq":604422,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:26.064500+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:35:26.064500+0000","last_peered":"2023-09-23T08:35:26.064500+0000","last_clean":"2023-09-23T08:35:26.064500+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:35:26.064500+0000","last_undegraded":"2023-09-23T08:35:26.064500+0000","last_fullsized":"2023-09-23T08:35:26.064500+0000","mapping_epoch":13,"log_start":"86'297107","ondisk_log_start":"86'297107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3060625727,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":297401,"num_read_kb":1165434,"num_write":293709,"num_write_kb":1174605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'290595","reported_seq":570355,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:26.061101+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:35:26.061101+0000","last_peered":"2023-09-23T08:35:26.061101+0000","last_clean":"2023-09-23T08:35:26.061101+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:35:26.061101+0000","last_undegraded":"2023-09-23T08:35:26.061101+0000","last_fullsized":"2023-09-23T08:35:26.061101+0000","mapping_epoch":13,"log_start":"86'280509","ondisk_log_start":"86'280509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2850959660,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":279144,"num_read_kb":1097673,"num_write":277079,"num_write_kb":1108229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'295733","reported_seq":591756,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:35:26.045595+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:35:26.045595+0000","last_peered":"2023-09-23T08:35:26.045595+0000","last_clean":"2023-09-23T08:35:26.045595+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:35:26.045595+0000","last_undegraded":"2023-09-23T08:35:26.045595+0000","last_fullsized":"2023-09-23T08:35:26.045595+0000","mapping_epoch":13,"log_start":"86'285707","ondisk_log_start":"86'285707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":392,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 210s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3050164506,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":296582,"num_read_kb":1172239,"num_write":294690,"num_write_kb":1178673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'288928","reported_seq":576855,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:28.410920+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:35:28.410920+0000","last_peered":"2023-09-23T08:35:28.410920+0000","last_clean":"2023-09-23T08:35:28.410920+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:35:28.410920+0000","last_undegraded":"2023-09-23T08:35:28.410920+0000","last_fullsized":"2023-09-23T08:35:28.410920+0000","mapping_epoch":13,"log_start":"86'278909","ondisk_log_start":"86'278909","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2943799614,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":287609,"num_read_kb":1131255,"num_write":285436,"num_write_kb":1141594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'298814","reported_seq":594085,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:35:30.027261+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:35:30.027261+0000","last_peered":"2023-09-23T08:35:30.027261+0000","last_clean":"2023-09-23T08:35:30.027261+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:35:30.027261+0000","last_undegraded":"2023-09-23T08:35:30.027261+0000","last_fullsized":"2023-09-23T08:35:30.027261+0000","mapping_epoch":13,"log_start":"87'288811","ondisk_log_start":"87'288811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1006,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 389s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3032543702,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":294546,"num_read_kb":1157600,"num_write":292135,"num_write_kb":1168420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'273267","reported_seq":543607,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:29.975079+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:35:29.975079+0000","last_peered":"2023-09-23T08:35:29.975079+0000","last_clean":"2023-09-23T08:35:29.975079+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:35:29.975079+0000","last_undegraded":"2023-09-23T08:35:29.975079+0000","last_fullsized":"2023-09-23T08:35:29.975079+0000","mapping_epoch":13,"log_start":"86'263208","ondisk_log_start":"86'263208","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2750099757,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":269498,"num_read_kb":1059201,"num_write":266455,"num_write_kb":1065733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'288534","reported_seq":567606,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:26.047668+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:35:26.047668+0000","last_peered":"2023-09-23T08:35:26.047668+0000","last_clean":"2023-09-23T08:35:26.047668+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:35:26.047668+0000","last_undegraded":"2023-09-23T08:35:26.047668+0000","last_fullsized":"2023-09-23T08:35:26.047668+0000","mapping_epoch":13,"log_start":"86'278506","ondisk_log_start":"86'278506","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2821218838,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":278352,"num_read_kb":1093683,"num_write":274223,"num_write_kb":1096775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":263,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:32.168703+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:33:32.168703+0000","last_peered":"2023-09-23T08:33:32.168703+0000","last_clean":"2023-09-23T08:33:32.168703+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:33:32.168703+0000","last_undegraded":"2023-09-23T08:33:32.168703+0000","last_fullsized":"2023-09-23T08:33:32.168703+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23249943339,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2271822,"num_read_kb":8933691,"num_write":2248604,"num_write_kb":8993441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17729396736,"data_stored":21846410838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80371,"ondisk_log_size":80371,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739315,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4721708,"kb_used_data":3207844,"kb_used_omap":319,"kb_used_meta":1513536,"kb_avail":89650132,"statfs":{"total":96636764160,"available":91801735168,"internally_reserved":0,"allocated":3284832256,"data_stored":4038318494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1549861100},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,2,2,2,8,5,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:35:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.81799999999999995},"min":{"1min":0.20899999999999999,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":6.5510000000000002,"5min":6.5510000000000002,"15min":10.922000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.64600000000000002,"15min":0.73999999999999999},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":0.625,"5min":6.4619999999999997,"15min":10.954000000000001},"last":0.33500000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:35:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":1.2210000000000001,"15min":1.0800000000000001},"min":{"1min":0.28199999999999997,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.2770000000000001,"5min":9.5709999999999997,"15min":11.65},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.292,"15min":1.363},"min":{"1min":0.25800000000000001,"5min":0.20399999999999999,"15min":0.182},"max":{"1min":3.7869999999999999,"5min":6.8559999999999999,"15min":14.311999999999999},"last":0.28000000000000003}]}]},{"osd":1,"up_from":8,"seq":34359739302,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10637560,"kb_used_data":8655532,"kb_used_omap":733,"kb_used_meta":1981282,"kb_avail":83734280,"statfs":{"total":96636764160,"available":85743902720,"internally_reserved":0,"allocated":8863264768,"data_stored":10922279376,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":751325,"internal_metadata":2028833059},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,6,5,9,2,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.76000000000000001,"15min":0.88100000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":3.1589999999999998,"5min":11.917,"15min":21.216000000000001},"last":0.315},{"interface":"front","average":{"1min":0.81599999999999995,"5min":1.1279999999999999,"15min":1.4830000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":4.0960000000000001,"5min":15.718,"15min":21.388999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.96199999999999997,"15min":1.0149999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.19700000000000001},"max":{"1min":3.1989999999999998,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.81000000000000005,"15min":0.95199999999999996},"min":{"1min":0.251,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":7.8170000000000002,"5min":7.8170000000000002,"15min":26.151},"last":0.27800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739310,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7215696,"kb_used_data":5451460,"kb_used_omap":416,"kb_used_meta":1763807,"kb_avail":87156144,"statfs":{"total":96636764160,"available":89247891456,"internally_reserved":0,"allocated":5582295040,"data_stored":6886849719,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":1806139112},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,4,1,7,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.3740000000000001,"15min":1.2150000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":6.1260000000000003,"5min":7.3330000000000002,"15min":21.207000000000001},"last":0.377},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.4770000000000001,"15min":1.1839999999999999},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.222},"max":{"1min":6.1520000000000001,"5min":7.3680000000000003,"15min":20.436},"last":0.44700000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:34:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.249,"5min":0.193,"15min":0.193},"max":{"1min":5.9390000000000001,"5min":6.9809999999999999,"15min":15.039999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.64800000000000002,"15min":0.81000000000000005},"min":{"1min":0.22800000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.81899999999999995,"5min":7.0410000000000004,"15min":21.757999999999999},"last":0.41599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5581627392,"data_stored":6886069778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8863444992,"data_stored":10922142507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3284324352,"data_stored":4038198553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:35:32.294 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:32.294 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:32.295 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:32.295 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:32.295 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:32.295 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:35:33.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:33.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:33.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.373+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:33.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:33.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:33.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:33.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:33.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:33.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:33.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:33.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:33.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:33.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:33.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:33.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:33.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:33.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:33.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:33.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:33.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:34.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:34.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:34.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:34.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:34.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:34.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:34.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:34.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:34.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:34.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:34.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:34.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:34.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:34.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:34.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:34.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:35.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:35.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:35.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:35.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:35.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:35.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:35.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:35.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:35.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:35.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:35.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:35.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:36.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:36.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:36.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:36.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:36.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:36.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:36.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:36.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:36.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:36.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:36.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:36.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:36.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:36.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:36.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:36.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:36.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:36.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:36.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:36.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:39.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:39.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:39.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:39.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:39.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:39.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:39.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:39.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:39.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:39.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:39.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:39.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:39.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:39.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:39.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.853+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:39.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:39.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:39.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:39.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:39.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:39.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:40.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:40.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.545+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:40.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:40.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:40.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:40.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:40.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:40.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:40.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:40.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:40.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:40.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:35:40.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:40.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:40.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:40.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:40.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.753+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:40.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:40.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:40.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:40.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:40.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:40.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:40.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:41.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:41.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:41.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:41.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:41.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:41.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:41.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:41.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:41.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:41.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:41.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:41.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:41.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:41.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:41.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:41.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:41.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:41.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:41.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:41.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:42.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:42.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:42.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:42.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:42.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:42.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:42.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:42.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:42.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:42.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:42.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:42.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:42.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:42.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:42.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:42.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:42.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:42.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:42.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:42.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:43.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:43.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:43.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:43.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:43.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:43.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:43.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:43.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:43.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:43.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:43.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:43.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:43.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:43.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:43.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:43.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:43.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:43.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:45.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:45.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:45.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:45.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:45.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:45.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:45.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:45.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:45.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:45.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:45.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:45.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:45.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:45.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:45.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:45.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:45.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:45.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:45.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:45.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:47.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:47.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:47.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:47.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:47.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:47.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:47.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:47.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:47.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:47.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:47.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:47.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:47.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:47.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:47.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:47.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:47.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:47.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:47.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:47.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:49.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:49.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:49.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:49.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:49.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:49.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:49.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:49.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:49.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:49.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:49.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:49.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:49.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:49.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:49.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:49.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:49.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:49.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:49.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:49.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:50.354 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:35:50.349+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:35:50.354 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:35:50.349+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:35:50.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:50.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:50.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:50.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:50.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:50.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:50.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:35:50.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:50.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:50.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:50.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:50.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:50.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:50.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:50.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:50.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:51.744 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:35:51.741+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:35:51.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:51.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:35:51.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:51.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:51.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:51.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:51.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:51.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:51.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:51.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:52.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:52.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:52.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:52.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:52.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:52.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:52.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:52.297 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:35:52.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:35:52.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:52.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:52.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:52.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:52.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:52.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:52.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:52.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:52.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:52.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:52.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:52.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:52.960 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:35:52.960 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:35:52.998 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2461,"stamp":"2023-09-23T08:35:52.483600+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23269109067,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2281141,"num_read_kb":8970626,"num_write":2257889,"num_write_kb":9031927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80432,"ondisk_log_size":80432,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22927260,"kb_used_data":17356088,"kb_used_omap":1469,"kb_used_meta":5569666,"kb_avail":260188260,"statfs":{"total":289910292480,"available":266432778240,"internally_reserved":0,"allocated":17772634112,"data_stored":21883377701,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1505033,"internal_metadata":5703338231},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,1,7,7,14,12,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10719232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5326,"num_read_kb":21296,"num_write":5267,"num_write_kb":21068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002434"},"pg_stats":[{"pgid":"2.7","version":"88'280104","reported_seq":550743,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:35:51.942937+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:35:51.942937+0000","last_peered":"2023-09-23T08:35:51.942937+0000","last_clean":"2023-09-23T08:35:51.942937+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:35:51.942937+0000","last_undegraded":"2023-09-23T08:35:51.942937+0000","last_fullsized":"2023-09-23T08:35:51.942937+0000","mapping_epoch":13,"log_start":"87'270011","ondisk_log_start":"87'270011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":806,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 303s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2742948175,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":269899,"num_read_kb":1061442,"num_write":266002,"num_write_kb":1063912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'308624","reported_seq":607193,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:51.931980+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:35:51.931980+0000","last_peered":"2023-09-23T08:35:51.931980+0000","last_clean":"2023-09-23T08:35:51.931980+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:35:51.931980+0000","last_undegraded":"2023-09-23T08:35:51.931980+0000","last_fullsized":"2023-09-23T08:35:51.931980+0000","mapping_epoch":13,"log_start":"87'298607","ondisk_log_start":"87'298607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3063554367,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":298728,"num_read_kb":1170738,"num_write":295062,"num_write_kb":1180017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'291910","reported_seq":572924,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:51.912361+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:35:51.912361+0000","last_peered":"2023-09-23T08:35:51.912361+0000","last_clean":"2023-09-23T08:35:51.912361+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:35:51.912361+0000","last_undegraded":"2023-09-23T08:35:51.912361+0000","last_fullsized":"2023-09-23T08:35:51.912361+0000","mapping_epoch":13,"log_start":"87'281909","ondisk_log_start":"87'281909","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2853396780,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":280382,"num_read_kb":1102621,"num_write":278316,"num_write_kb":1113177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'297051","reported_seq":594402,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:35:51.922468+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:35:51.922468+0000","last_peered":"2023-09-23T08:35:51.922468+0000","last_clean":"2023-09-23T08:35:51.922468+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:35:51.922468+0000","last_undegraded":"2023-09-23T08:35:51.922468+0000","last_fullsized":"2023-09-23T08:35:51.922468+0000","mapping_epoch":13,"log_start":"87'287007","ondisk_log_start":"87'287007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":436,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 236s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3052749082,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":297900,"num_read_kb":1177511,"num_write":295982,"num_write_kb":1183841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'289929","reported_seq":578845,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:48.704887+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:35:48.704887+0000","last_peered":"2023-09-23T08:35:48.704887+0000","last_clean":"2023-09-23T08:35:48.704887+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:35:48.704887+0000","last_undegraded":"2023-09-23T08:35:48.704887+0000","last_fullsized":"2023-09-23T08:35:48.704887+0000","mapping_epoch":13,"log_start":"87'279909","ondisk_log_start":"87'279909","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2945761598,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":288590,"num_read_kb":1135179,"num_write":286435,"num_write_kb":1145590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'299860","reported_seq":596174,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:35:50.249038+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:35:50.249038+0000","last_peered":"2023-09-23T08:35:50.249038+0000","last_clean":"2023-09-23T08:35:50.249038+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:35:50.249038+0000","last_undegraded":"2023-09-23T08:35:50.249038+0000","last_fullsized":"2023-09-23T08:35:50.249038+0000","mapping_epoch":13,"log_start":"87'289811","ondisk_log_start":"87'289811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1060,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 409s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3034587606,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":295570,"num_read_kb":1161696,"num_write":293138,"num_write_kb":1172432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'274204","reported_seq":545497,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:50.204007+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:35:50.204007+0000","last_peered":"2023-09-23T08:35:50.204007+0000","last_clean":"2023-09-23T08:35:50.204007+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:35:50.204007+0000","last_undegraded":"2023-09-23T08:35:50.204007+0000","last_fullsized":"2023-09-23T08:35:50.204007+0000","mapping_epoch":13,"log_start":"86'264108","ondisk_log_start":"86'264108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2751901997,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":270439,"num_read_kb":1062965,"num_write":267383,"num_write_kb":1069445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'289819","reported_seq":570080,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:35:51.889702+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:35:51.889702+0000","last_peered":"2023-09-23T08:35:51.889702+0000","last_clean":"2023-09-23T08:35:51.889702+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:35:51.889702+0000","last_undegraded":"2023-09-23T08:35:51.889702+0000","last_fullsized":"2023-09-23T08:35:51.889702+0000","mapping_epoch":13,"log_start":"87'279806","ondisk_log_start":"87'279806","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2823619094,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":279527,"num_read_kb":1098383,"num_write":275434,"num_write_kb":1101619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":263,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:32.168703+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:33:32.168703+0000","last_peered":"2023-09-23T08:33:32.168703+0000","last_clean":"2023-09-23T08:33:32.168703+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:33:32.168703+0000","last_undegraded":"2023-09-23T08:33:32.168703+0000","last_fullsized":"2023-09-23T08:33:32.168703+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23268518699,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2281035,"num_read_kb":8970535,"num_write":2257752,"num_write_kb":9030033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17771319296,"data_stored":21882107478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80333,"ondisk_log_size":80333,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739319,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4796304,"kb_used_data":3214472,"kb_used_omap":319,"kb_used_meta":1581504,"kb_avail":89575536,"statfs":{"total":96636764160,"available":91725348864,"internally_reserved":0,"allocated":3291619328,"data_stored":4044167582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1619460332},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,3,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:35:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.81799999999999995},"min":{"1min":0.20899999999999999,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":6.5510000000000002,"5min":6.5510000000000002,"15min":10.922000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.64600000000000002,"15min":0.73999999999999999},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":0.625,"5min":6.4619999999999997,"15min":10.954000000000001},"last":3.6070000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:35:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":1.2210000000000001,"15min":1.0800000000000001},"min":{"1min":0.28199999999999997,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.2770000000000001,"5min":9.5709999999999997,"15min":11.65},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.292,"15min":1.363},"min":{"1min":0.25800000000000001,"5min":0.20399999999999999,"15min":0.182},"max":{"1min":3.7869999999999999,"5min":6.8559999999999999,"15min":14.311999999999999},"last":0.26700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739307,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10801008,"kb_used_data":8678748,"kb_used_omap":733,"kb_used_meta":2121506,"kb_avail":83570832,"statfs":{"total":96636764160,"available":85576531968,"internally_reserved":0,"allocated":8887037952,"data_stored":10942435792,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":751325,"internal_metadata":2172422435},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,6,2,8,8],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.76000000000000001,"15min":0.88100000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.17699999999999999},"max":{"1min":3.1589999999999998,"5min":11.917,"15min":21.216000000000001},"last":0.191},{"interface":"front","average":{"1min":0.81599999999999995,"5min":1.1279999999999999,"15min":1.4830000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":4.0960000000000001,"5min":15.718,"15min":21.388999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.96199999999999997,"15min":1.0149999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.19700000000000001},"max":{"1min":3.1989999999999998,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.311},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.81000000000000005,"15min":0.95199999999999996},"min":{"1min":0.251,"5min":0.23000000000000001,"15min":0.20100000000000001},"max":{"1min":7.8170000000000002,"5min":7.8170000000000002,"15min":26.151},"last":0.33400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739314,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7329948,"kb_used_data":5462868,"kb_used_omap":416,"kb_used_meta":1866655,"kb_avail":87041892,"statfs":{"total":96636764160,"available":89130897408,"internally_reserved":0,"allocated":5593976832,"data_stored":6896774327,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":1911455464},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,1,2,6,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.3740000000000001,"15min":1.2150000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":6.1260000000000003,"5min":7.3330000000000002,"15min":21.207000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.4770000000000001,"15min":1.1839999999999999},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.222},"max":{"1min":6.1520000000000001,"5min":7.3680000000000003,"15min":20.436},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:34:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.83399999999999996,"15min":0.82999999999999996},"min":{"1min":0.249,"5min":0.193,"15min":0.193},"max":{"1min":5.9390000000000001,"5min":6.9809999999999999,"15min":15.039999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.64800000000000002,"15min":0.81000000000000005},"min":{"1min":0.22800000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.81899999999999995,"5min":7.0410000000000004,"15min":21.757999999999999},"last":0.44600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5593464832,"data_stored":6896129554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8886784000,"data_stored":10941950763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3291070464,"data_stored":4044027161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:35:52.999 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:53.000 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:53.000 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:53.000 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:53.000 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:35:53.000 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:35:53.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:35:53.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:53.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:53.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:53.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:53.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:53.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:53.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:53.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:53.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:53.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:53.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:53.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:56.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:56.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:56.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:56.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:56.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:56.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:56.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:56.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:56.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:56.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:56.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:56.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:35:56.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:56.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:35:56.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:56.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:56.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:56.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:56.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:35:56.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:56.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:35:59.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:59.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:35:59.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:59.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:35:59.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:59.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:35:59.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:59.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:35:59.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:59.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:35:59.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:59.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:35:59.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:59.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:35:59.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:35:59.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:00.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:00.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:00.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:00.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:00.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:00.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:00.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:00.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:00.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:00.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:00.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:00.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:01.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:01.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:01.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:01.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:01.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:01.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:01.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:01.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:01.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:01.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:01.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:01.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:01.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:01.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:01.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:01.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:01.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:01.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:01.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:01.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:01.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:01.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:01.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:02.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:02.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:02.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:02.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:02.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:02.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:02.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:02.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:02.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:02.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:02.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:02.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:03.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:03.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:03.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:03.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:03.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:03.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:03.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:03.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:03.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:03.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:03.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:03.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:03.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:03.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:03.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:03.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:03.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:03.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:03.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:03.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:03.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:03.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:36:03.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:03.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:03.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:03.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:03.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:03.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:03.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:03.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:03.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:03.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:03.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:03.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:04.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:04.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:04.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:04.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:04.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:04.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:04.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:04.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:04.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:04.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:04.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:04.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:06.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:06.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:06.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:06.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:06.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:06.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:06.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:06.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:06.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:06.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:06.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:06.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:06.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:06.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:06.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:06.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:06.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:06.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:06.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:06.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:07.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:07.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:07.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:07.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:07.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:07.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:07.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:07.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:07.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:07.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:07.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:07.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:07.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:07.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:07.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:07.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:07.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:07.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:11.121 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:11.116+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:36:11.121 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:11.116+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:36:12.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:12.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:12.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:12.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:12.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:12.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:12.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:12.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:12.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:12.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:12.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:12.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:13.002 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:36:13.962 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:36:13.963 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:36:13.996 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2471,"stamp":"2023-09-23T08:36:12.488710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23285304651,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2289036,"num_read_kb":9002202,"num_write":2265723,"num_write_kb":9063263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80469,"ondisk_log_size":80469,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22461384,"kb_used_data":17392168,"kb_used_omap":1531,"kb_used_meta":5067652,"kb_avail":260654136,"statfs":{"total":289910292480,"available":266909835264,"internally_reserved":0,"allocated":17809580032,"data_stored":21914822693,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1568155,"internal_metadata":5189276261},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,1,1,8,14,10,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10788864,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5162,"num_read_kb":20644,"num_write":5146,"num_write_kb":20584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003797"},"pg_stats":[{"pgid":"2.7","version":"88'281090","reported_seq":552724,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:36:12.468098+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:36:12.468098+0000","last_peered":"2023-09-23T08:36:12.468098+0000","last_clean":"2023-09-23T08:36:12.468098+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:36:12.468098+0000","last_undegraded":"2023-09-23T08:36:12.468098+0000","last_fullsized":"2023-09-23T08:36:12.468098+0000","mapping_epoch":13,"log_start":"87'271011","ondisk_log_start":"87'271011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":847,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 324s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2744799567,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":270869,"num_read_kb":1065322,"num_write":266916,"num_write_kb":1067568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'309720","reported_seq":609313,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:12.451917+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:36:12.451917+0000","last_peered":"2023-09-23T08:36:12.451917+0000","last_clean":"2023-09-23T08:36:12.451917+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:36:12.451917+0000","last_undegraded":"2023-09-23T08:36:12.451917+0000","last_fullsized":"2023-09-23T08:36:12.451917+0000","mapping_epoch":13,"log_start":"87'299707","ondisk_log_start":"87'299707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3065745727,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":299743,"num_read_kb":1174798,"num_write":296109,"num_write_kb":1184205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'292886","reported_seq":574893,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:12.440941+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:36:12.440941+0000","last_peered":"2023-09-23T08:36:12.440941+0000","last_clean":"2023-09-23T08:36:12.440941+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:36:12.440941+0000","last_undegraded":"2023-09-23T08:36:12.440941+0000","last_fullsized":"2023-09-23T08:36:12.440941+0000","mapping_epoch":13,"log_start":"87'282809","ondisk_log_start":"87'282809","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2855235884,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":281363,"num_read_kb":1106545,"num_write":279244,"num_write_kb":1116889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'298103","reported_seq":596524,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:36:12.351163+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:36:12.351163+0000","last_peered":"2023-09-23T08:36:12.351163+0000","last_clean":"2023-09-23T08:36:12.351163+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:36:12.351163+0000","last_undegraded":"2023-09-23T08:36:12.351163+0000","last_fullsized":"2023-09-23T08:36:12.351163+0000","mapping_epoch":13,"log_start":"87'288007","ondisk_log_start":"87'288007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":469,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 256s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3054940442,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":298964,"num_read_kb":1181767,"num_write":297012,"num_write_kb":1187961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'290926","reported_seq":580813,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:08.823822+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:36:08.823822+0000","last_peered":"2023-09-23T08:36:08.823822+0000","last_clean":"2023-09-23T08:36:08.823822+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:36:08.823822+0000","last_undegraded":"2023-09-23T08:36:08.823822+0000","last_fullsized":"2023-09-23T08:36:08.823822+0000","mapping_epoch":13,"log_start":"87'280909","ondisk_log_start":"87'280909","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2947879230,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":289560,"num_read_kb":1139059,"num_write":287426,"num_write_kb":1149554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'300924","reported_seq":598279,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:36:10.363060+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:36:10.363060+0000","last_peered":"2023-09-23T08:36:10.363060+0000","last_clean":"2023-09-23T08:36:10.363060+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:36:10.363060+0000","last_undegraded":"2023-09-23T08:36:10.363060+0000","last_fullsized":"2023-09-23T08:36:10.363060+0000","mapping_epoch":13,"log_start":"87'290911","ondisk_log_start":"87'290911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1099,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 429s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3036619222,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":296588,"num_read_kb":1165768,"num_write":294162,"num_write_kb":1176528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'275138","reported_seq":547363,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:10.351086+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:36:10.351086+0000","last_peered":"2023-09-23T08:36:10.351086+0000","last_clean":"2023-09-23T08:36:10.351086+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:36:10.351086+0000","last_undegraded":"2023-09-23T08:36:10.351086+0000","last_fullsized":"2023-09-23T08:36:10.351086+0000","mapping_epoch":13,"log_start":"87'265108","ondisk_log_start":"87'265108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2753818925,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":271356,"num_read_kb":1066629,"num_write":268302,"num_write_kb":1073121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'290851","reported_seq":572087,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:12.412721+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:36:12.412721+0000","last_peered":"2023-09-23T08:36:12.412721+0000","last_clean":"2023-09-23T08:36:12.412721+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:36:12.412721+0000","last_undegraded":"2023-09-23T08:36:12.412721+0000","last_fullsized":"2023-09-23T08:36:12.412721+0000","mapping_epoch":13,"log_start":"87'280806","ondisk_log_start":"87'280806","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2825675286,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":280487,"num_read_kb":1102223,"num_write":276415,"num_write_kb":1105543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":263,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:33:32.168703+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:33:32.168703+0000","last_peered":"2023-09-23T08:33:32.168703+0000","last_clean":"2023-09-23T08:33:32.168703+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:33:32.168703+0000","last_undegraded":"2023-09-23T08:33:32.168703+0000","last_fullsized":"2023-09-23T08:33:32.168703+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23284714283,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2288930,"num_read_kb":9002111,"num_write":2265586,"num_write_kb":9061369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17808617472,"data_stored":21913892438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80370,"ondisk_log_size":80370,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739323,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4853072,"kb_used_data":3221316,"kb_used_omap":319,"kb_used_meta":1631424,"kb_avail":89518768,"statfs":{"total":96636764160,"available":91667218432,"internally_reserved":0,"allocated":3298627584,"data_stored":4050172318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1670578412},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:35:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.81799999999999995},"min":{"1min":0.20899999999999999,"5min":0.186,"15min":0.17199999999999999},"max":{"1min":6.5510000000000002,"5min":6.5510000000000002,"15min":10.922000000000001},"last":0.255},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.64600000000000002,"15min":0.73999999999999999},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.20499999999999999},"max":{"1min":0.625,"5min":6.4619999999999997,"15min":10.954000000000001},"last":0.28599999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:35:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":1.2210000000000001,"15min":1.0800000000000001},"min":{"1min":0.28199999999999997,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.2770000000000001,"5min":9.5709999999999997,"15min":11.65},"last":0.315},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.292,"15min":1.363},"min":{"1min":0.25800000000000001,"5min":0.20399999999999999,"15min":0.182},"max":{"1min":3.7869999999999999,"5min":6.8559999999999999,"15min":14.311999999999999},"last":0.65100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739311,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10185228,"kb_used_data":8696896,"kb_used_omap":795,"kb_used_meta":1487524,"kb_avail":84186612,"statfs":{"total":96636764160,"available":86207090688,"internally_reserved":0,"allocated":8905621504,"data_stored":10958299600,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":814447,"internal_metadata":1523225233},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,1,0,6,9,8,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.78800000000000003,"15min":0.89500000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":2.9470000000000001,"5min":11.917,"15min":21.216000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.1100000000000001,"15min":1.5009999999999999},"min":{"1min":0.17899999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":3.9039999999999999,"5min":15.718,"15min":21.388999999999999},"last":0.22500000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0249999999999999,"15min":1},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21199999999999999},"max":{"1min":7.9909999999999997,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.81200000000000006,"15min":0.94999999999999996},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.20100000000000001},"max":{"1min":1.2689999999999999,"5min":7.8170000000000002,"15min":26.151},"last":0.34200000000000003}]}]},{"osd":0,"up_from":8,"seq":34359739318,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7423084,"kb_used_data":5473956,"kb_used_omap":416,"kb_used_meta":1948703,"kb_avail":86948756,"statfs":{"total":96636764160,"available":89035526144,"internally_reserved":0,"allocated":5605330944,"data_stored":6906350775,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":1995472616},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.3740000000000001,"15min":1.2150000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":6.1260000000000003,"5min":7.3330000000000002,"15min":21.207000000000001},"last":2.6349999999999998},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.4770000000000001,"15min":1.1839999999999999},"min":{"1min":0.26100000000000001,"5min":0.25600000000000001,"15min":0.222},"max":{"1min":6.1520000000000001,"5min":7.3680000000000003,"15min":20.436},"last":2.6659999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.83399999999999996},"min":{"1min":0.224,"5min":0.215,"15min":0.193},"max":{"1min":2.6339999999999999,"5min":6.9809999999999999,"15min":15.039999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.73699999999999999},"min":{"1min":0.27800000000000002,"5min":0.184,"15min":0.184},"max":{"1min":6.1779999999999999,"5min":7.0410000000000004,"15min":20.491},"last":0.26500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5605015552,"data_stored":6905857554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8905617408,"data_stored":10958093099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3297984512,"data_stored":4049941785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:36:13.998 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:36:13.998 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:36:13.998 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:36:13.998 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:36:13.998 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:36:13.999 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-09-23T08:36:14.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:14.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:36:14.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:14.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:14.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:14.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:14.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:14.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:14.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:14.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:14.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:14.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:14.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:14.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:14.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:14.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:14.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:14.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:14.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:14.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:14.730 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-09-23T08:36:14.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-09-23T08:36:15.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:15.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:15.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:15.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:15.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:15.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:15.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:15.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:15.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:15.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:15.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:15.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:15.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:15.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:15.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:15.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:15.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:15.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:15.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:15.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:15.754 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-09-23T08:36:15.819 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-09-23T08:36:16.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:16.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:16.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:16.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:16.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:16.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:16.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:16.562 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-09-23T08:36:16.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:16.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:16.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:16.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:16.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:16.624 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-09-23T08:36:17.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.392+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:36:17.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:17.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:17.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:17.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:17.447 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-09-23T08:36:17.506 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-09-23T08:36:17.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:17.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:17.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:17.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:17.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:17.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:17.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:17.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:18.168 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-09-23T08:36:18.232 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:36:20.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:20.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:20.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:20.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:20.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:20.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:20.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:20.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:20.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:20.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:20.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:20.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:21.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:20.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:21.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:21.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:21.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:21.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:21.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:21.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:21.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:21.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:21.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:21.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:21.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:21.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:21.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:21.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:21.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:21.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:21.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:21.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:21.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:21.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:21.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:21.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:21.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:24.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:24.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:24.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:24.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:25.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:25.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:25.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:25.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:25.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:25.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:25.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:25.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:25.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:25.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:25.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:25.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:25.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:25.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:25.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:25.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:25.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:25.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:25.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:25.754 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:25.748+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:36:25.754 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:25.748+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:36:27.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:27.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:27.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:27.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:27.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:27.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:27.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:27.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:27.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:27.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:27.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:27.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:27.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:27.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:27.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:27.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:27.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:27.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:27.478 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:27.472+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:36:27.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:27.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:30.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:30.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:30.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:30.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:30.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:30.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:30.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:30.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:30.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:30.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:30.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:30.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:30.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:30.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:30.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:30.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:30.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:30.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:30.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:30.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:31.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:31.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:31.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:31.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:31.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:31.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:31.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:31.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:31.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:31.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:31.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:31.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:31.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:31.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:31.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:31.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:31.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:31.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:31.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:31.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:33.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:33.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:33.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:33.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:34.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:34.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:34.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:34.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:34.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:34.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:34.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:34.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:34.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:34.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:34.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:34.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:34.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:34.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:35.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:35.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:35.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:35.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:35.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:35.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:35.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:35.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:35.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:35.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:35.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:35.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:35.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:35.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:35.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:35.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:35.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:35.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:35.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:35.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:36.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:36.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:36.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:36.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:36.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:36.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:36.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:36.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:36.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:36.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:36.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:36.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:36.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:36.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:36.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:36.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:36.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:36.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:36.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:36.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:38.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:36:38.941 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:36:38.941 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:36:38.977 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2484,"stamp":"2023-09-23T08:36:38.496966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23305260363,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2298383,"num_read_kb":9039582,"num_write":2275428,"num_write_kb":9102083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80429,"ondisk_log_size":80429,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22885336,"kb_used_data":17437108,"kb_used_omap":1531,"kb_used_meta":5446660,"kb_avail":260230184,"statfs":{"total":289910292480,"available":266475708416,"internally_reserved":0,"allocated":17855598592,"data_stored":21953804325,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1568155,"internal_metadata":5577380453},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,2,4,8,3,6,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10633216,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4984,"num_read_kb":19932,"num_write":5225,"num_write_kb":20900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002063"},"pg_stats":[{"pgid":"2.7","version":"88'282335","reported_seq":555111,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:36:38.296499+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:36:38.296499+0000","last_peered":"2023-09-23T08:36:38.296499+0000","last_clean":"2023-09-23T08:36:38.296499+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:36:38.296499+0000","last_undegraded":"2023-09-23T08:36:38.296499+0000","last_fullsized":"2023-09-23T08:36:38.296499+0000","mapping_epoch":13,"log_start":"87'272311","ondisk_log_start":"87'272311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":905,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 350s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2747056463,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":271983,"num_read_kb":1069778,"num_write":268080,"num_write_kb":1072224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'311044","reported_seq":611867,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:38.300618+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:36:38.300618+0000","last_peered":"2023-09-23T08:36:38.300618+0000","last_clean":"2023-09-23T08:36:38.300618+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:36:38.300618+0000","last_undegraded":"2023-09-23T08:36:38.300618+0000","last_fullsized":"2023-09-23T08:36:38.300618+0000","mapping_epoch":13,"log_start":"87'301007","ondisk_log_start":"87'301007","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3068539199,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":300957,"num_read_kb":1179654,"num_write":297387,"num_write_kb":1189317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'294167","reported_seq":577355,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:38.251643+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:36:38.251643+0000","last_peered":"2023-09-23T08:36:38.251643+0000","last_clean":"2023-09-23T08:36:38.251643+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:36:38.251643+0000","last_undegraded":"2023-09-23T08:36:38.251643+0000","last_fullsized":"2023-09-23T08:36:38.251643+0000","mapping_epoch":13,"log_start":"87'284109","ondisk_log_start":"87'284109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2857722156,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":282528,"num_read_kb":1111205,"num_write":280480,"num_write_kb":1121833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'299427","reported_seq":599090,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:36:38.242801+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:36:38.242801+0000","last_peered":"2023-09-23T08:36:38.242801+0000","last_clean":"2023-09-23T08:36:38.242801+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:36:38.242801+0000","last_undegraded":"2023-09-23T08:36:38.242801+0000","last_fullsized":"2023-09-23T08:36:38.242801+0000","mapping_epoch":13,"log_start":"87'289407","ondisk_log_start":"87'289407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":511,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 282s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3057684762,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":300198,"num_read_kb":1186703,"num_write":298311,"num_write_kb":1193157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'292122","reported_seq":583188,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:33.951161+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:36:33.951161+0000","last_peered":"2023-09-23T08:36:33.951161+0000","last_clean":"2023-09-23T08:36:33.951161+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:36:33.951161+0000","last_undegraded":"2023-09-23T08:36:33.951161+0000","last_fullsized":"2023-09-23T08:36:33.951161+0000","mapping_epoch":13,"log_start":"87'282109","ondisk_log_start":"87'282109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2950353214,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":290722,"num_read_kb":1143707,"num_write":288620,"num_write_kb":1154330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'302197","reported_seq":600784,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:36:35.633368+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:36:35.633368+0000","last_peered":"2023-09-23T08:36:35.633368+0000","last_clean":"2023-09-23T08:36:35.633368+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:36:35.633368+0000","last_undegraded":"2023-09-23T08:36:35.633368+0000","last_fullsized":"2023-09-23T08:36:35.633368+0000","mapping_epoch":13,"log_start":"87'292111","ondisk_log_start":"87'292111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1171,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 455s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3039048150,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":297794,"num_read_kb":1170592,"num_write":295358,"num_write_kb":1181312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'276328","reported_seq":549635,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:35.672504+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:36:35.672504+0000","last_peered":"2023-09-23T08:36:35.672504+0000","last_clean":"2023-09-23T08:36:35.672504+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:36:35.672504+0000","last_undegraded":"2023-09-23T08:36:35.672504+0000","last_fullsized":"2023-09-23T08:36:35.672504+0000","mapping_epoch":13,"log_start":"87'266308","ondisk_log_start":"87'266308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2756190509,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":272423,"num_read_kb":1070897,"num_write":269459,"num_write_kb":1077749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'292078","reported_seq":574514,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:38.235081+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:36:38.235081+0000","last_peered":"2023-09-23T08:36:38.235081+0000","last_clean":"2023-09-23T08:36:38.235081+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:36:38.235081+0000","last_undegraded":"2023-09-23T08:36:38.235081+0000","last_fullsized":"2023-09-23T08:36:38.235081+0000","mapping_epoch":13,"log_start":"87'282006","ondisk_log_start":"87'282006","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2828075542,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":281672,"num_read_kb":1106955,"num_write":277596,"num_write_kb":1110267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":264,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:29.307286+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:34:29.307286+0000","last_peered":"2023-09-23T08:34:29.307286+0000","last_clean":"2023-09-23T08:34:29.307286+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:34:29.307286+0000","last_undegraded":"2023-09-23T08:34:29.307286+0000","last_fullsized":"2023-09-23T08:34:29.307286+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23304669995,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2298277,"num_read_kb":9039491,"num_write":2275291,"num_write_kb":9100189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17854607360,"data_stored":21952841302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80330,"ondisk_log_size":80330,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739328,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4937452,"kb_used_data":3229412,"kb_used_omap":319,"kb_used_meta":1707712,"kb_avail":89434388,"statfs":{"total":96636764160,"available":91580813312,"internally_reserved":0,"allocated":3306917888,"data_stored":4057242014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1748697324},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,1,1,1,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.86299999999999999,"15min":0.78800000000000003},"min":{"1min":0.219,"5min":0.191,"15min":0.17199999999999999},"max":{"1min":2.0150000000000001,"5min":6.5510000000000002,"15min":10.922000000000001},"last":0.25},{"interface":"front","average":{"1min":0.501,"5min":0.60499999999999998,"15min":0.71899999999999997},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":3.6070000000000002,"5min":6.4619999999999997,"15min":10.954000000000001},"last":0.28399999999999997}]},{"osd":1,"last update":"Sat Sep 23 08:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":1.1759999999999999,"15min":1.0289999999999999},"min":{"1min":0.29899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.2519999999999998,"5min":9.5709999999999997,"15min":11.65},"last":0.316},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.173,"15min":1.3169999999999999},"min":{"1min":0.23699999999999999,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":4.2350000000000003,"5min":6.8559999999999999,"15min":14.311999999999999},"last":0.33100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739316,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10377724,"kb_used_data":8719788,"kb_used_omap":795,"kb_used_meta":1657124,"kb_avail":83994116,"statfs":{"total":96636764160,"available":86009974784,"internally_reserved":0,"allocated":8929062912,"data_stored":10978136528,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":814447,"internal_metadata":1696895633},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,1,1,6,1,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.78800000000000003,"15min":0.89500000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":2.9470000000000001,"5min":11.917,"15min":21.216000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.1100000000000001,"15min":1.5009999999999999},"min":{"1min":0.17899999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":3.9039999999999999,"5min":15.718,"15min":21.388999999999999},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0249999999999999,"15min":1},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21199999999999999},"max":{"1min":7.9909999999999997,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.81200000000000006,"15min":0.94999999999999996},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.20100000000000001},"max":{"1min":1.2689999999999999,"5min":7.8170000000000002,"15min":26.151},"last":0.502}]}]},{"osd":0,"up_from":8,"seq":34359739323,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7570160,"kb_used_data":5487908,"kb_used_omap":416,"kb_used_meta":2081823,"kb_avail":86801680,"statfs":{"total":96636764160,"available":88884920320,"internally_reserved":0,"allocated":5619617792,"data_stored":6918425783,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":2131787496},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,1,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:36:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.244,"15min":1.077},"min":{"1min":0.19400000000000001,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":5.7220000000000004,"5min":7.3330000000000002,"15min":8.7569999999999997},"last":0.20200000000000001},{"interface":"front","average":{"1min":1.286,"5min":1.29,"15min":1.222},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":5.7599999999999998,"5min":7.3680000000000003,"15min":20.436},"last":0.27400000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.83399999999999996},"min":{"1min":0.224,"5min":0.215,"15min":0.193},"max":{"1min":2.6339999999999999,"5min":6.9809999999999999,"15min":15.039999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.73699999999999999},"min":{"1min":0.27800000000000002,"5min":0.184,"15min":0.184},"max":{"1min":6.1779999999999999,"5min":7.0410000000000004,"15min":20.491},"last":0.372}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5619175424,"data_stored":6917826066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8929075200,"data_stored":10977921835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3306356736,"data_stored":4057093401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:36:38.979 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:36:38.979 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:36:38.980 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:36:38.980 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:36:38.980 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:36:38.981 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:36:39.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:39.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:39.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:39.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:39.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:39.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:39.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:39.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:39.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:39.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:39.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:39.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:39.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:39.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:39.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:39.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:39.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:39.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:39.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:39.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:39.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:39.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:44.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:44.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:44.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:44.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:44.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:44.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:44.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:44.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:44.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:44.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:44.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:44.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:44.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:44.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:45.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:45.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:45.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:45.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:45.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:45.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:45.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:45.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:45.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:45.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:45.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:45.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:46.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:46.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:46.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:46.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:46.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:46.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:46.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:46.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:46.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:36:46.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:46.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:46.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:46.259 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:46.256+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:36:46.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:46.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:46.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:46.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:46.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:46.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:36:46.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:46.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:46.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:46.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:46.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:46.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:46.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:46.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:46.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:46.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:46.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:46.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:46.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:46.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:46.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:46.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:46.731 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:46.728+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:36:46.731 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:46.728+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:36:46.742 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:46.736+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:36:46.742 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:46.736+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:36:46.742 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:46.736+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:36:48.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:48.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:48.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:48.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:48.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:48.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:48.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:48.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:48.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:48.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:48.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:48.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:48.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:48.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:48.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:48.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:48.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:48.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:49.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:49.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:49.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:49.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:49.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:49.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:49.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:49.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:49.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:49.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:49.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:49.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:49.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:49.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:52.090 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:36:52.084+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:36:52.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:52.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:52.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:52.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:52.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:52.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:52.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:52.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:52.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:52.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:52.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:52.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:52.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:52.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:52.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:52.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:52.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:52.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:52.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:52.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:52.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:55.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.584+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:55.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:55.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:55.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:55.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:55.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:55.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:55.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:55.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:55.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:55.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:55.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:55.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:55.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:55.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:55.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:55.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:55.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:55.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:55.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:56.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:56.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:36:56.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:56.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:56.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:56.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:56.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:56.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:56.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:56.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:56.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:56.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:56.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:56.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:56.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:56.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:56.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:56.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:56.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:56.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:57.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:36:57.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:36:57.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:36:57.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:36:57.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:36:57.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:36:57.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:36:57.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:57.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:57.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:57.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:57.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:58.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:58.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:36:58.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:58.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:36:58.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:58.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:36:58.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:58.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:36:58.983 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:36:59.960 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:36:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:36:59.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:36:59.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:00.022 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2494,"stamp":"2023-09-23T08:36:58.502706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23318871371,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2304774,"num_read_kb":9065146,"num_write":2281974,"num_write_kb":9128267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80662,"ondisk_log_size":80662,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23183244,"kb_used_data":17469364,"kb_used_omap":1531,"kb_used_meta":5712324,"kb_avail":259932276,"statfs":{"total":289910292480,"available":266170650624,"internally_reserved":0,"allocated":17888628736,"data_stored":21981988901,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1568155,"internal_metadata":5849420389},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,7,5,11,12,8,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8015872,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3803,"num_read_kb":15212,"num_write":3896,"num_write_kb":15584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001988"},"pg_stats":[{"pgid":"2.7","version":"88'283082","reported_seq":556556,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:36:53.688422+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:36:53.688422+0000","last_peered":"2023-09-23T08:36:53.688422+0000","last_clean":"2023-09-23T08:36:53.688422+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:36:53.688422+0000","last_undegraded":"2023-09-23T08:36:53.688422+0000","last_fullsized":"2023-09-23T08:36:53.688422+0000","mapping_epoch":13,"log_start":"87'273011","ondisk_log_start":"87'273011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":926,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 365s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2748420431,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":272673,"num_read_kb":1072538,"num_write":268777,"num_write_kb":1075012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'311882","reported_seq":613442,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:53.679602+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:36:53.679602+0000","last_peered":"2023-09-23T08:36:53.679602+0000","last_clean":"2023-09-23T08:36:53.679602+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:36:53.679602+0000","last_undegraded":"2023-09-23T08:36:53.679602+0000","last_fullsized":"2023-09-23T08:36:53.679602+0000","mapping_epoch":13,"log_start":"88'301807","ondisk_log_start":"88'301807","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3070243135,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":301689,"num_read_kb":1182582,"num_write":298185,"num_write_kb":1192509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'294904","reported_seq":578773,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:53.679577+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:36:53.679577+0000","last_peered":"2023-09-23T08:36:53.679577+0000","last_clean":"2023-09-23T08:36:53.679577+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:36:53.679577+0000","last_undegraded":"2023-09-23T08:36:53.679577+0000","last_fullsized":"2023-09-23T08:36:53.679577+0000","mapping_epoch":13,"log_start":"87'284809","ondisk_log_start":"87'284809","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2859172140,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":283200,"num_read_kb":1113893,"num_write":281184,"num_write_kb":1124649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'300205","reported_seq":600657,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:36:53.707844+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:36:53.707844+0000","last_peered":"2023-09-23T08:36:53.707844+0000","last_clean":"2023-09-23T08:36:53.707844+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:36:53.707844+0000","last_undegraded":"2023-09-23T08:36:53.707844+0000","last_fullsized":"2023-09-23T08:36:53.707844+0000","mapping_epoch":13,"log_start":"88'290107","ondisk_log_start":"88'290107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":532,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 297s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3059290394,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":300982,"num_read_kb":1189839,"num_write":299074,"num_write_kb":1196209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'293162","reported_seq":585125,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:54.123700+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:36:54.123700+0000","last_peered":"2023-09-23T08:36:54.123700+0000","last_clean":"2023-09-23T08:36:54.123700+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:36:54.123700+0000","last_undegraded":"2023-09-23T08:36:54.123700+0000","last_fullsized":"2023-09-23T08:36:54.123700+0000","mapping_epoch":13,"log_start":"87'283109","ondisk_log_start":"87'283109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2952507710,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":291615,"num_read_kb":1147279,"num_write":289654,"num_write_kb":1158466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'303246","reported_seq":602850,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:36:55.827667+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:36:55.827667+0000","last_peered":"2023-09-23T08:36:55.827667+0000","last_clean":"2023-09-23T08:36:55.827667+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:36:55.827667+0000","last_undegraded":"2023-09-23T08:36:55.827667+0000","last_fullsized":"2023-09-23T08:36:55.827667+0000","mapping_epoch":13,"log_start":"88'293211","ondisk_log_start":"88'293211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1223,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 475s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3041145302,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":298786,"num_read_kb":1174560,"num_write":296339,"num_write_kb":1185236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'277246","reported_seq":551479,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:55.798679+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:36:55.798679+0000","last_peered":"2023-09-23T08:36:55.798679+0000","last_clean":"2023-09-23T08:36:55.798679+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:36:55.798679+0000","last_undegraded":"2023-09-23T08:36:55.798679+0000","last_fullsized":"2023-09-23T08:36:55.798679+0000","mapping_epoch":13,"log_start":"87'267208","ondisk_log_start":"87'267208","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2757955885,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":273335,"num_read_kb":1074545,"num_write":270341,"num_write_kb":1081277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'292804","reported_seq":575960,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:53.657321+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:36:53.657321+0000","last_peered":"2023-09-23T08:36:53.657321+0000","last_clean":"2023-09-23T08:36:53.657321+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:36:53.657321+0000","last_undegraded":"2023-09-23T08:36:53.657321+0000","last_fullsized":"2023-09-23T08:36:53.657321+0000","mapping_epoch":13,"log_start":"87'282706","ondisk_log_start":"87'282706","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2829546006,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":282388,"num_read_kb":1109819,"num_write":278283,"num_write_kb":1113015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":264,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:29.307286+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:34:29.307286+0000","last_peered":"2023-09-23T08:34:29.307286+0000","last_clean":"2023-09-23T08:34:29.307286+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:34:29.307286+0000","last_undegraded":"2023-09-23T08:34:29.307286+0000","last_fullsized":"2023-09-23T08:34:29.307286+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23318281003,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2304668,"num_read_kb":9065055,"num_write":2281837,"num_write_kb":9126373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17887219712,"data_stored":21980722774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80563,"ondisk_log_size":80563,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739332,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5007928,"kb_used_data":3236080,"kb_used_omap":319,"kb_used_meta":1771520,"kb_avail":89363912,"statfs":{"total":96636764160,"available":91508645888,"internally_reserved":0,"allocated":3313745920,"data_stored":4063123870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1814036716},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.86299999999999999,"15min":0.78800000000000003},"min":{"1min":0.219,"5min":0.191,"15min":0.17199999999999999},"max":{"1min":2.0150000000000001,"5min":6.5510000000000002,"15min":10.922000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.60499999999999998,"15min":0.71899999999999997},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":3.6070000000000002,"5min":6.4619999999999997,"15min":10.954000000000001},"last":0.21299999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":1.1759999999999999,"15min":1.0289999999999999},"min":{"1min":0.29899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.2519999999999998,"5min":9.5709999999999997,"15min":11.65},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.173,"15min":1.3169999999999999},"min":{"1min":0.23699999999999999,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":4.2350000000000003,"5min":6.8559999999999999,"15min":14.311999999999999},"last":6.2149999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739319,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10511348,"kb_used_data":8733868,"kb_used_omap":795,"kb_used_meta":1776676,"kb_avail":83860492,"statfs":{"total":96636764160,"available":85873143808,"internally_reserved":0,"allocated":8943480832,"data_stored":10990445008,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":814447,"internal_metadata":1819316881},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,6,2,7,7,4,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.78800000000000003,"15min":0.89500000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":2.9470000000000001,"5min":11.917,"15min":21.216000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.1100000000000001,"15min":1.5009999999999999},"min":{"1min":0.17899999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":3.9039999999999999,"5min":15.718,"15min":21.388999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0249999999999999,"15min":1},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21199999999999999},"max":{"1min":7.9909999999999997,"5min":10.798999999999999,"15min":26.117000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.81200000000000006,"15min":0.94999999999999996},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.20100000000000001},"max":{"1min":1.2689999999999999,"5min":7.8170000000000002,"15min":26.151},"last":0.32200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739327,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7663968,"kb_used_data":5499416,"kb_used_omap":416,"kb_used_meta":2164127,"kb_avail":86707872,"statfs":{"total":96636764160,"available":88788860928,"internally_reserved":0,"allocated":5631401984,"data_stored":6928420023,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":426264,"internal_metadata":2216066792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,3,3,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:36:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.244,"15min":1.077},"min":{"1min":0.19400000000000001,"5min":0.186,"15min":0.17000000000000001},"max":{"1min":5.7220000000000004,"5min":7.3330000000000002,"15min":8.7569999999999997},"last":0.23699999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.29,"15min":1.222},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":5.7599999999999998,"5min":7.3680000000000003,"15min":20.436},"last":0.30399999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.83399999999999996},"min":{"1min":0.224,"5min":0.215,"15min":0.193},"max":{"1min":2.6339999999999999,"5min":6.9809999999999999,"15min":15.039999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.73699999999999999},"min":{"1min":0.27800000000000002,"5min":0.184,"15min":0.184},"max":{"1min":6.1779999999999999,"5min":7.0410000000000004,"15min":20.491},"last":0.27500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5631000576,"data_stored":6927877650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8943140864,"data_stored":10989955883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3313078272,"data_stored":4062889241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:37:00.023 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:00.024 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:00.024 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:00.024 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:00.024 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:00.025 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:37:00.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:00.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:00.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:00.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:00.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:00.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:00.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:00.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:00.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:00.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:00.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:00.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:00.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:00.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:00.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:00.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:00.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:00.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:00.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:00.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:04.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:04.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:04.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:04.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:04.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:04.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:04.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:04.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:04.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:04.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:04.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:04.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:04.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:04.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:04.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:04.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:04.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:04.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:04.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:04.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:04.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:04.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:04.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:05.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:05.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:05.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:05.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:05.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:05.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:05.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:05.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:05.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:05.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:05.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:05.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:06.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:06.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:06.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:06.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:06.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:06.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:06.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:06.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:06.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:06.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:06.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:06.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:06.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:06.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:06.680 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:06.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:06.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:06.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:08.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:08.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:08.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:08.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:08.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:08.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:08.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:08.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:08.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:08.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:08.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:08.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:08.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:08.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:08.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:08.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:11.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:11.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:11.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:11.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:11.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:11.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:11.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:11.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:11.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:11.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:11.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:11.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:11.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:11.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:11.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:11.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:12.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:12.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:12.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:12.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:12.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:12.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:12.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:12.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:12.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:12.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:12.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:12.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:12.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:12.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:13.985 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:37:13.979+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:37:14.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:14.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:14.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:14.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:14.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:14.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:14.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:14.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:14.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:14.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:14.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:14.955+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:14.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:14.959+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:14.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:14.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:14.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:14.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:15.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:15.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:15.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:15.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:15.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:15.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:15.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:15.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:15.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:15.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:15.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:15.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:15.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:15.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:15.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:15.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:15.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:15.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:15.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:15.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:15.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:15.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:15.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:16.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:16.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:16.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:16.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:16.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:16.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:16.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:16.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:16.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:16.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:16.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:16.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:18.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:18.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:18.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:18.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:18.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:18.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:18.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:18.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:18.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:18.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:18.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:18.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:19.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:19.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:19.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:19.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:19.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:19.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:19.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:19.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:19.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:19.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:19.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:19.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:19.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:19.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:19.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:19.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:20.025 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:37:20.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:20.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:20.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:20.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:20.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:20.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:20.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.719+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:20.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:20.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:20.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:20.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:20.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:20.916 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:37:20.917 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:37:20.992 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2505,"stamp":"2023-09-23T08:37:20.506241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23338188107,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2313987,"num_read_kb":9101974,"num_write":2291468,"num_write_kb":9166243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80442,"ondisk_log_size":80442,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22792952,"kb_used_data":17513364,"kb_used_omap":1582,"kb_used_meta":5277969,"kb_avail":260322568,"statfs":{"total":289910292480,"available":266570309632,"internally_reserved":0,"allocated":17933684736,"data_stored":22020663333,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1620162,"internal_metadata":5404641086},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,4,6,11,17,6,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11137024,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5417,"num_read_kb":21664,"num_write":5462,"num_write_kb":21848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001954"},"pg_stats":[{"pgid":"2.7","version":"88'284343","reported_seq":559001,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:37:19.634333+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:37:19.634333+0000","last_peered":"2023-09-23T08:37:19.634333+0000","last_clean":"2023-09-23T08:37:19.634333+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:37:19.634333+0000","last_undegraded":"2023-09-23T08:37:19.634333+0000","last_fullsized":"2023-09-23T08:37:19.634333+0000","mapping_epoch":13,"log_start":"88'274311","ondisk_log_start":"88'274311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":992,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 391s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2750886223,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":273825,"num_read_kb":1077142,"num_write":269938,"num_write_kb":1079656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'313239","reported_seq":616090,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:19.642393+0000","last_change":"2023-09-23T07:31:06.817812+0000","last_active":"2023-09-23T08:37:19.642393+0000","last_peered":"2023-09-23T08:37:19.642393+0000","last_clean":"2023-09-23T08:37:19.642393+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:37:19.642393+0000","last_undegraded":"2023-09-23T08:37:19.642393+0000","last_fullsized":"2023-09-23T08:37:19.642393+0000","mapping_epoch":13,"log_start":"88'303207","ondisk_log_start":"88'303207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3073024319,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":302966,"num_read_kb":1187686,"num_write":299482,"num_write_kb":1197697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'296210","reported_seq":581287,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:19.613867+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:37:19.613867+0000","last_peered":"2023-09-23T08:37:19.613867+0000","last_clean":"2023-09-23T08:37:19.613867+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:37:19.613867+0000","last_undegraded":"2023-09-23T08:37:19.613867+0000","last_fullsized":"2023-09-23T08:37:19.613867+0000","mapping_epoch":13,"log_start":"88'286209","ondisk_log_start":"88'286209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2861613356,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":284394,"num_read_kb":1118665,"num_write":282430,"num_write_kb":1129633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'301599","reported_seq":603309,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:37:19.562468+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:37:19.562468+0000","last_peered":"2023-09-23T08:37:19.562468+0000","last_clean":"2023-09-23T08:37:19.562468+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:37:19.562468+0000","last_undegraded":"2023-09-23T08:37:19.562468+0000","last_fullsized":"2023-09-23T08:37:19.562468+0000","mapping_epoch":13,"log_start":"88'291508","ondisk_log_start":"88'291508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":568,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 323s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3062133018,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":302228,"num_read_kb":1194819,"num_write":300446,"num_write_kb":1201697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'294431","reported_seq":587594,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:19.452394+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:37:19.452394+0000","last_peered":"2023-09-23T08:37:19.452394+0000","last_clean":"2023-09-23T08:37:19.452394+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:37:19.452394+0000","last_undegraded":"2023-09-23T08:37:19.452394+0000","last_fullsized":"2023-09-23T08:37:19.452394+0000","mapping_epoch":13,"log_start":"88'284409","ondisk_log_start":"88'284409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2955043134,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":292802,"num_read_kb":1152023,"num_write":290913,"num_write_kb":1163502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'304327","reported_seq":604977,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:37:15.959543+0000","last_change":"2023-09-23T08:29:00.375633+0000","last_active":"2023-09-23T08:37:15.959543+0000","last_peered":"2023-09-23T08:37:15.959543+0000","last_clean":"2023-09-23T08:37:15.959543+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:37:15.959543+0000","last_undegraded":"2023-09-23T08:37:15.959543+0000","last_fullsized":"2023-09-23T08:37:15.959543+0000","mapping_epoch":13,"log_start":"88'294311","ondisk_log_start":"88'294311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1260,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 495s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3043234262,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":299817,"num_read_kb":1178684,"num_write":297372,"num_write_kb":1189368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'278194","reported_seq":553371,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:15.950020+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:37:15.950020+0000","last_peered":"2023-09-23T08:37:15.950020+0000","last_clean":"2023-09-23T08:37:15.950020+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:37:15.950020+0000","last_undegraded":"2023-09-23T08:37:15.950020+0000","last_fullsized":"2023-09-23T08:37:15.950020+0000","mapping_epoch":13,"log_start":"88'268108","ondisk_log_start":"88'268108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2759766317,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":274267,"num_read_kb":1078269,"num_write":271262,"num_write_kb":1084961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'294069","reported_seq":578429,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:19.486247+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:37:19.486247+0000","last_peered":"2023-09-23T08:37:19.486247+0000","last_clean":"2023-09-23T08:37:19.486247+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:37:19.486247+0000","last_undegraded":"2023-09-23T08:37:19.486247+0000","last_fullsized":"2023-09-23T08:37:19.486247+0000","mapping_epoch":13,"log_start":"88'284006","ondisk_log_start":"88'284006","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2831897110,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":283582,"num_read_kb":1114595,"num_write":279488,"num_write_kb":1117835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":264,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:29.307286+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:34:29.307286+0000","last_peered":"2023-09-23T08:34:29.307286+0000","last_clean":"2023-09-23T08:34:29.307286+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:34:29.307286+0000","last_undegraded":"2023-09-23T08:34:29.307286+0000","last_fullsized":"2023-09-23T08:34:29.307286+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23337597739,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2313881,"num_read_kb":9101883,"num_write":2291331,"num_write_kb":9164349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6290,"num_omap_keys":104,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17932402688,"data_stored":22019446358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80343,"ondisk_log_size":80343,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739336,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5028280,"kb_used_data":3242544,"kb_used_omap":319,"kb_used_meta":1785408,"kb_avail":89343560,"statfs":{"total":96636764160,"available":91487805440,"internally_reserved":0,"allocated":3320365056,"data_stored":4068764062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1828258028},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,2,2,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.86299999999999999,"15min":0.78800000000000003},"min":{"1min":0.219,"5min":0.191,"15min":0.17199999999999999},"max":{"1min":2.0150000000000001,"5min":6.5510000000000002,"15min":10.922000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.60499999999999998,"15min":0.71899999999999997},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":3.6070000000000002,"5min":6.4619999999999997,"15min":10.954000000000001},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":1.1759999999999999,"15min":1.0289999999999999},"min":{"1min":0.29899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.2519999999999998,"5min":9.5709999999999997,"15min":11.65},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.173,"15min":1.3169999999999999},"min":{"1min":0.23699999999999999,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":4.2350000000000003,"5min":6.8559999999999999,"15min":14.311999999999999},"last":1.083}]}]},{"osd":1,"up_from":8,"seq":34359739324,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10727304,"kb_used_data":8756920,"kb_used_omap":795,"kb_used_meta":1969572,"kb_avail":83644536,"statfs":{"total":96636764160,"available":85652004864,"internally_reserved":0,"allocated":8967086080,"data_stored":11010703824,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":814447,"internal_metadata":2016842385},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,2,4,8,15,2,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.81299999999999994,"15min":0.87},"min":{"1min":0.20799999999999999,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":9.9459999999999997,"5min":11.917,"15min":21.216000000000001},"last":0.22800000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.161,"15min":1.504},"min":{"1min":0.188,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":10.022,"5min":15.718,"15min":21.388999999999999},"last":0.30299999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.89500000000000002,"15min":0.95799999999999996},"min":{"1min":0.223,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.5499999999999998,"5min":7.9909999999999997,"15min":26.117000000000001},"last":1.73},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.84399999999999997,"15min":0.872},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":5.2640000000000002,"5min":7.8170000000000002,"15min":26.151},"last":0.32200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739332,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7037368,"kb_used_data":5513900,"kb_used_omap":467,"kb_used_meta":1522988,"kb_avail":87334472,"statfs":{"total":96636764160,"available":89430499328,"internally_reserved":0,"allocated":5646233600,"data_stored":6941195447,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":1559540673},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.121,"15min":1.012},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.17299999999999999},"max":{"1min":1.3680000000000001,"5min":7.3330000000000002,"15min":7.3330000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.167,"15min":1.1819999999999999},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":1.3999999999999999,"5min":7.3680000000000003,"15min":20.436},"last":0.498}]},{"osd":2,"last update":"Sat Sep 23 08:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67000000000000004,"15min":0.80200000000000005},"min":{"1min":0.217,"5min":0.217,"15min":0.193},"max":{"1min":2.3290000000000002,"5min":6.1120000000000001,"15min":12.529},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.52500000000000002,"15min":0.71999999999999997},"min":{"1min":0.26300000000000001,"5min":0.22800000000000001,"15min":0.184},"max":{"1min":3.0550000000000002,"5min":6.1779999999999999,"15min":20.491},"last":0.52600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5645824000,"data_stored":6940640786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8966852608,"data_stored":11010267947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3319726080,"data_stored":4068537625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:37:20.994 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:20.994 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:20.994 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:20.994 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:20.994 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:20.995 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:37:21.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:21.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:21.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:21.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:21.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:21.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:21.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:21.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:22.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:21.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:22.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:21.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:22.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:21.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:22.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:22.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:22.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:22.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:22.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:22.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:23.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:23.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:23.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:23.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:23.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:23.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:23.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:23.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:23.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:23.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:23.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:23.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:23.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:26.133 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:37:26.127+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:37:27.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:27.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:27.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:27.387+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:27.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:27.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:27.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:27.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:27.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:27.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:27.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:27.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:27.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:27.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:27.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:27.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:27.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:27.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:27.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:27.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:28.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:28.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:28.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:28.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:28.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:28.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:28.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:28.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:28.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:28.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:28.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:28.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:29.084 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:37:29.079+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:37:29.084 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:37:29.079+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:37:29.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:29.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:29.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:29.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:29.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:29.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:29.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:29.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:29.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:29.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.731+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:29.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:29.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:32.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:32.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:32.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:32.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:32.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:32.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:32.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:32.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:32.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:32.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:32.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:32.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:36.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:36.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:36.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:36.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:36.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:36.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:36.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:36.759+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:36.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:36.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:36.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:36.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:36.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:36.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:39.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:39.094 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:39.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:39.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:39.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:39.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:39.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:39.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:39.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:39.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:39.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:39.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:39.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:39.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:39.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:39.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:39.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:39.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:39.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:39.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:39.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:39.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:39.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:39.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:39.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:39.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:39.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:37:40.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:40.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:40.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:40.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:40.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:40.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:40.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:40.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:40.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:40.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:40.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:40.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:40.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:37:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:37:41.908 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:37:41.963 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2515,"stamp":"2023-09-23T08:37:40.509765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23353511243,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2321392,"num_read_kb":9131558,"num_write":2298858,"num_write_kb":9195803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8465,"num_omap_keys":137,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80460,"ondisk_log_size":80460,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23145316,"kb_used_data":17548096,"kb_used_omap":1582,"kb_used_meta":5595601,"kb_avail":259970204,"statfs":{"total":289910292480,"available":266209488896,"internally_reserved":0,"allocated":17969250304,"data_stored":22051313701,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1620162,"internal_metadata":5729896254},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,3,8,11,9,11,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10412032,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4926,"num_read_kb":19672,"num_write":4980,"num_write_kb":19920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001950"},"pg_stats":[{"pgid":"2.7","version":"88'285283","reported_seq":560823,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:37:40.037852+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:37:40.037852+0000","last_peered":"2023-09-23T08:37:40.037852+0000","last_clean":"2023-09-23T08:37:40.037852+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:37:40.037852+0000","last_undegraded":"2023-09-23T08:37:40.037852+0000","last_fullsized":"2023-09-23T08:37:40.037852+0000","mapping_epoch":13,"log_start":"88'275211","ondisk_log_start":"88'275211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1067,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 412s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2752663887,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":274685,"num_read_kb":1080578,"num_write":270795,"num_write_kb":1083084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'314229","reported_seq":618046,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:37:40.030252+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:37:40.030252+0000","last_peered":"2023-09-23T08:37:40.030252+0000","last_clean":"2023-09-23T08:37:40.030252+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:37:40.030252+0000","last_undegraded":"2023-09-23T08:37:40.030252+0000","last_fullsized":"2023-09-23T08:37:40.030252+0000","mapping_epoch":13,"log_start":"88'304207","ondisk_log_start":"88'304207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":4,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 8s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3074933055,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":303916,"num_read_kb":1191482,"num_write":300430,"num_write_kb":1201489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'297169","reported_seq":583157,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:40.018936+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:37:40.018936+0000","last_peered":"2023-09-23T08:37:40.018936+0000","last_clean":"2023-09-23T08:37:40.018936+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:37:40.018936+0000","last_undegraded":"2023-09-23T08:37:40.018936+0000","last_fullsized":"2023-09-23T08:37:40.018936+0000","mapping_epoch":13,"log_start":"88'287109","ondisk_log_start":"88'287109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2863571244,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":285293,"num_read_kb":1122257,"num_write":283352,"num_write_kb":1133321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'302622","reported_seq":605314,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:37:40.004270+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:37:40.004270+0000","last_peered":"2023-09-23T08:37:40.004270+0000","last_clean":"2023-09-23T08:37:40.004270+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:37:40.004270+0000","last_undegraded":"2023-09-23T08:37:40.004270+0000","last_fullsized":"2023-09-23T08:37:40.004270+0000","mapping_epoch":13,"log_start":"88'292610","ondisk_log_start":"88'292610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":643,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 344s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3064262938,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":303204,"num_read_kb":1198723,"num_write":301421,"num_write_kb":1205597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'295397","reported_seq":589471,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:39.812204+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:37:39.812204+0000","last_peered":"2023-09-23T08:37:39.812204+0000","last_clean":"2023-09-23T08:37:39.812204+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:37:39.812204+0000","last_undegraded":"2023-09-23T08:37:39.812204+0000","last_fullsized":"2023-09-23T08:37:39.812204+0000","mapping_epoch":13,"log_start":"88'285309","ondisk_log_start":"88'285309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2957005118,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":293705,"num_read_kb":1155623,"num_write":291869,"num_write_kb":1167326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'305319","reported_seq":606970,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:36.125999+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:37:36.125999+0000","last_peered":"2023-09-23T08:37:36.125999+0000","last_clean":"2023-09-23T08:37:36.125999+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:37:36.125999+0000","last_undegraded":"2023-09-23T08:37:36.125999+0000","last_fullsized":"2023-09-23T08:37:36.125999+0000","mapping_epoch":13,"log_start":"88'295311","ondisk_log_start":"88'295311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3045163478,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":300793,"num_read_kb":1182588,"num_write":298312,"num_write_kb":1193128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'279115","reported_seq":555229,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:36.127133+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:37:36.127133+0000","last_peered":"2023-09-23T08:37:36.127133+0000","last_clean":"2023-09-23T08:37:36.127133+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:37:36.127133+0000","last_undegraded":"2023-09-23T08:37:36.127133+0000","last_fullsized":"2023-09-23T08:37:36.127133+0000","mapping_epoch":13,"log_start":"88'269108","ondisk_log_start":"88'269108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2761601325,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":275194,"num_read_kb":1081973,"num_write":272162,"num_write_kb":1088561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'294998","reported_seq":580290,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:39.989030+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:37:39.989030+0000","last_peered":"2023-09-23T08:37:39.989030+0000","last_clean":"2023-09-23T08:37:39.989030+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:37:39.989030+0000","last_undegraded":"2023-09-23T08:37:39.989030+0000","last_fullsized":"2023-09-23T08:37:39.989030+0000","mapping_epoch":13,"log_start":"88'284906","ondisk_log_start":"88'284906","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2833719830,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":284496,"num_read_kb":1118243,"num_write":280380,"num_write_kb":1121403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":264,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:29.307286+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:34:29.307286+0000","last_peered":"2023-09-23T08:34:29.307286+0000","last_clean":"2023-09-23T08:34:29.307286+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:34:29.307286+0000","last_undegraded":"2023-09-23T08:34:29.307286+0000","last_fullsized":"2023-09-23T08:34:29.307286+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23352920875,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2321286,"num_read_kb":9131467,"num_write":2298721,"num_write_kb":9193909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8465,"num_omap_keys":137,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17968259072,"data_stored":22050379350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80361,"ondisk_log_size":80361,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739340,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5108512,"kb_used_data":3248856,"kb_used_omap":319,"kb_used_meta":1859328,"kb_avail":89263328,"statfs":{"total":96636764160,"available":91405647872,"internally_reserved":0,"allocated":3326828544,"data_stored":4074260894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1903952108},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.81599999999999995,"15min":0.75900000000000001},"min":{"1min":0.22800000000000001,"5min":0.19400000000000001,"15min":0.17199999999999999},"max":{"1min":1.768,"5min":6.5510000000000002,"15min":10.922000000000001},"last":3.3879999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61299999999999999,"15min":0.70199999999999996},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.2309999999999999,"5min":6.4619999999999997,"15min":10.954000000000001},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.0009999999999999,"15min":0.98499999999999999},"min":{"1min":0.23899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.6040000000000001,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0329999999999999,"15min":1.337},"min":{"1min":0.23100000000000001,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":6.2149999999999999,"5min":6.2149999999999999,"15min":14.311999999999999},"last":0.23300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739328,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10906432,"kb_used_data":8774444,"kb_used_omap":795,"kb_used_meta":2131172,"kb_avail":83465408,"statfs":{"total":96636764160,"available":85468577792,"internally_reserved":0,"allocated":8985030656,"data_stored":11026178512,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":814447,"internal_metadata":2182320785},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,3,5,9,9,11,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.81299999999999994,"15min":0.87},"min":{"1min":0.20799999999999999,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":9.9459999999999997,"5min":11.917,"15min":21.216000000000001},"last":0.25},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.161,"15min":1.504},"min":{"1min":0.188,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":10.022,"5min":15.718,"15min":21.388999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.89500000000000002,"15min":0.95799999999999996},"min":{"1min":0.223,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.5499999999999998,"5min":7.9909999999999997,"15min":26.117000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.84399999999999997,"15min":0.872},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":5.2640000000000002,"5min":7.8170000000000002,"15min":26.151},"last":0.30099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739336,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7130372,"kb_used_data":5524796,"kb_used_omap":467,"kb_used_meta":1605100,"kb_avail":87241468,"statfs":{"total":96636764160,"available":89335263232,"internally_reserved":0,"allocated":5657391104,"data_stored":6950874295,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":1643623361},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,0,3,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.121,"15min":1.012},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.17299999999999999},"max":{"1min":1.3680000000000001,"5min":7.3330000000000002,"15min":7.3330000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.167,"15min":1.1819999999999999},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":1.3999999999999999,"5min":7.3680000000000003,"15min":20.436},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67000000000000004,"15min":0.80200000000000005},"min":{"1min":0.217,"5min":0.217,"15min":0.193},"max":{"1min":2.3290000000000002,"5min":6.1120000000000001,"15min":12.529},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.52500000000000002,"15min":0.71999999999999997},"min":{"1min":0.26300000000000001,"5min":0.22800000000000001,"15min":0.184},"max":{"1min":3.0550000000000002,"5min":6.1779999999999999,"15min":20.491},"last":0.40699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5657194496,"data_stored":6950491666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8984854528,"data_stored":11025816363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3326210048,"data_stored":4074071321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:37:41.964 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:41.964 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:41.965 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:41.965 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:37:41.965 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:37:42.560 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:37:42.555+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:37:43.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:43.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:43.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:43.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:43.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:43.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:43.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:43.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:43.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:43.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:43.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:43.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:43.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:43.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:43.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:43.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:45.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:37:45.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:45.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:45.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:45.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:45.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:45.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:45.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:45.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:45.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:45.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:45.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:45.335+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:46.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:46.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:46.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:46.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:46.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:46.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:46.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:46.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:46.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:46.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:46.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:46.931+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:46.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:46.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:46.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:46.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:46.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:46.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:48.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:48.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:48.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:48.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:48.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:48.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:48.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:48.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:48.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:48.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:48.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:48.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:49.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:49.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:50.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:49.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:50.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:50.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:50.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:50.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:50.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:50.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:50.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:50.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:50.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:50.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:50.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:50.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:50.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:50.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:53.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:37:53.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:53.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:53.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:53.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:53.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:53.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:53.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:53.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:53.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:53.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:53.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:53.943+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:54.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:54.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:54.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:54.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:54.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:54.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:54.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:54.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:54.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:54.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:54.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:54.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:54.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:54.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:54.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:54.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:56.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:55.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:56.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:37:56.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:56.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:56.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:56.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:56.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:56.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:56.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:56.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:56.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:56.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:56.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:56.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:56.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:56.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:56.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:56.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:56.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:56.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:56.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:56.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:56.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:56.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:56.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:56.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:56.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:56.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:58.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:37:58.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:37:58.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:37:58.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:58.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:58.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:58.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:58.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:58.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:58.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:58.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:58.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:37:59.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:59.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:37:59.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:59.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:37:59.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:59.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:37:59.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:59.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:37:59.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:59.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:37:59.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:59.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:37:59.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:59.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:37:59.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:37:59.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:00.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:00.155+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:00.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:00.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:00.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:00.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:00.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:00.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:00.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:00.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:00.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:00.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:00.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:00.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:00.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:00.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:00.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:00.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:00.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:00.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:01.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:01.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:01.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:01.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:01.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:01.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:01.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:01.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:01.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:01.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:01.966 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:38:01.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:01.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:02.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:02.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:01.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:02.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:02.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:02.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:02.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:02.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:02.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.159+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:02.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.239+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:02.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:02.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:02.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:02.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:02.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:02.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:02.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:02.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:38:02.839 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:38:02.883 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2526,"stamp":"2023-09-23T08:38:02.515227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23370706251,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2329346,"num_read_kb":9163374,"num_write":2307036,"num_write_kb":9228515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8465,"num_omap_keys":137,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80527,"ondisk_log_size":80527,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23546696,"kb_used_data":17587244,"kb_used_omap":1582,"kb_used_meta":5957841,"kb_avail":259568824,"statfs":{"total":289910292480,"available":265798475776,"internally_reserved":0,"allocated":18009337856,"data_stored":22085904421,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1620162,"internal_metadata":6100830014},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,4,6,9,16,10,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9076736,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4191,"num_read_kb":16764,"num_write":4295,"num_write_kb":17180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001967"},"pg_stats":[{"pgid":"2.7","version":"88'286265","reported_seq":562747,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:38:00.716009+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:38:00.716009+0000","last_peered":"2023-09-23T08:38:00.716009+0000","last_clean":"2023-09-23T08:38:00.716009+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:38:00.716009+0000","last_undegraded":"2023-09-23T08:38:00.716009+0000","last_fullsized":"2023-09-23T08:38:00.716009+0000","mapping_epoch":13,"log_start":"88'276211","ondisk_log_start":"88'276211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1115,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 432s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2754625871,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":275607,"num_read_kb":1084266,"num_write":271699,"num_write_kb":1086700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'315339","reported_seq":620175,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:38:00.664743+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:38:00.664743+0000","last_peered":"2023-09-23T08:38:00.664743+0000","last_clean":"2023-09-23T08:38:00.664743+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:38:00.664743+0000","last_undegraded":"2023-09-23T08:38:00.664743+0000","last_fullsized":"2023-09-23T08:38:00.664743+0000","mapping_epoch":13,"log_start":"88'305307","ondisk_log_start":"88'305307","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":27,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 29s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3077161279,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":304914,"num_read_kb":1195474,"num_write":301476,"num_write_kb":1205673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'298156","reported_seq":585112,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:00.634282+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:38:00.634282+0000","last_peered":"2023-09-23T08:38:00.634282+0000","last_clean":"2023-09-23T08:38:00.634282+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:38:00.634282+0000","last_undegraded":"2023-09-23T08:38:00.634282+0000","last_fullsized":"2023-09-23T08:38:00.634282+0000","mapping_epoch":13,"log_start":"88'288109","ondisk_log_start":"88'288109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2865398060,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":286247,"num_read_kb":1126073,"num_write":284291,"num_write_kb":1137077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'303685","reported_seq":607373,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:38:00.686746+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:38:00.686746+0000","last_peered":"2023-09-23T08:38:00.686746+0000","last_clean":"2023-09-23T08:38:00.686746+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:38:00.686746+0000","last_undegraded":"2023-09-23T08:38:00.686746+0000","last_fullsized":"2023-09-23T08:38:00.686746+0000","mapping_epoch":13,"log_start":"88'293610","ondisk_log_start":"88'293610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":684,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 364s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3066466586,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":304190,"num_read_kb":1202667,"num_write":302459,"num_write_kb":1209749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'296342","reported_seq":591307,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:37:59.944195+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:37:59.944195+0000","last_peered":"2023-09-23T08:37:59.944195+0000","last_clean":"2023-09-23T08:37:59.944195+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:37:59.944195+0000","last_undegraded":"2023-09-23T08:37:59.944195+0000","last_fullsized":"2023-09-23T08:37:59.944195+0000","mapping_epoch":13,"log_start":"88'286309","ondisk_log_start":"88'286309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2958979390,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":294589,"num_read_kb":1159159,"num_write":292812,"num_write_kb":1171098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'306558","reported_seq":609446,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:01.221447+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:38:01.221447+0000","last_peered":"2023-09-23T08:38:01.221447+0000","last_clean":"2023-09-23T08:38:01.221447+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:38:01.221447+0000","last_undegraded":"2023-09-23T08:38:01.221447+0000","last_fullsized":"2023-09-23T08:38:01.221447+0000","mapping_epoch":13,"log_start":"88'296511","ondisk_log_start":"88'296511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3047862742,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":302018,"num_read_kb":1187488,"num_write":299539,"num_write_kb":1198036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'280270","reported_seq":557473,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:01.234589+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:38:01.234589+0000","last_peered":"2023-09-23T08:38:01.234589+0000","last_clean":"2023-09-23T08:38:01.234589+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:38:01.234589+0000","last_undegraded":"2023-09-23T08:38:01.234589+0000","last_fullsized":"2023-09-23T08:38:01.234589+0000","mapping_epoch":13,"log_start":"88'270208","ondisk_log_start":"88'270208","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2763927853,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":276267,"num_read_kb":1086265,"num_write":273305,"num_write_kb":1093133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'295984","reported_seq":582201,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:00.635856+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:38:00.635856+0000","last_peered":"2023-09-23T08:38:00.635856+0000","last_clean":"2023-09-23T08:38:00.635856+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:38:00.635856+0000","last_undegraded":"2023-09-23T08:38:00.635856+0000","last_fullsized":"2023-09-23T08:38:00.635856+0000","mapping_epoch":13,"log_start":"88'285906","ondisk_log_start":"88'285906","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2835694102,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":285408,"num_read_kb":1121891,"num_write":281318,"num_write_kb":1125155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":264,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:29.307286+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:34:29.307286+0000","last_peered":"2023-09-23T08:34:29.307286+0000","last_clean":"2023-09-23T08:34:29.307286+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:34:29.307286+0000","last_undegraded":"2023-09-23T08:34:29.307286+0000","last_fullsized":"2023-09-23T08:34:29.307286+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23370115883,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2329240,"num_read_kb":9163283,"num_write":2306899,"num_write_kb":9226621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8465,"num_omap_keys":137,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18007293952,"data_stored":22084068950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80428,"ondisk_log_size":80428,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739345,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5211580,"kb_used_data":3257268,"kb_used_omap":319,"kb_used_meta":1953984,"kb_avail":89160260,"statfs":{"total":96636764160,"available":91300106240,"internally_reserved":0,"allocated":3335442432,"data_stored":4081793438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":2000879852},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,0,2,1,5,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.81599999999999995,"15min":0.75900000000000001},"min":{"1min":0.22800000000000001,"5min":0.19400000000000001,"15min":0.17199999999999999},"max":{"1min":1.768,"5min":6.5510000000000002,"15min":10.922000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61299999999999999,"15min":0.70199999999999996},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.2309999999999999,"5min":6.4619999999999997,"15min":10.954000000000001},"last":0.26300000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.0009999999999999,"15min":0.98499999999999999},"min":{"1min":0.23899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.6040000000000001,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":3.7210000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0329999999999999,"15min":1.337},"min":{"1min":0.23100000000000001,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":6.2149999999999999,"5min":6.2149999999999999,"15min":14.311999999999999},"last":3.7000000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739332,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11096556,"kb_used_data":8793376,"kb_used_omap":795,"kb_used_meta":2302372,"kb_avail":83275284,"statfs":{"total":96636764160,"available":85273890816,"internally_reserved":0,"allocated":9004417024,"data_stored":11042898384,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":814447,"internal_metadata":2357629585},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,4,6,10,3,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.81299999999999994,"15min":0.87},"min":{"1min":0.20799999999999999,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":9.9459999999999997,"5min":11.917,"15min":21.216000000000001},"last":0.248},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.161,"15min":1.504},"min":{"1min":0.188,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":10.022,"5min":15.718,"15min":21.388999999999999},"last":0.54700000000000004}]},{"osd":2,"last update":"Sat Sep 23 08:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.89500000000000002,"15min":0.95799999999999996},"min":{"1min":0.223,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.5499999999999998,"5min":7.9909999999999997,"15min":26.117000000000001},"last":0.216},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.84399999999999997,"15min":0.872},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":5.2640000000000002,"5min":7.8170000000000002,"15min":26.151},"last":0.34499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359739340,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7238560,"kb_used_data":5536600,"kb_used_omap":467,"kb_used_meta":1701484,"kb_avail":87133280,"statfs":{"total":96636764160,"available":89224478720,"internally_reserved":0,"allocated":5669478400,"data_stored":6961212599,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":1742320577},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1,5,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.121,"15min":1.012},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.17299999999999999},"max":{"1min":1.3680000000000001,"5min":7.3330000000000002,"15min":7.3330000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.167,"15min":1.1819999999999999},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":1.3999999999999999,"5min":7.3680000000000003,"15min":20.436},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67000000000000004,"15min":0.80200000000000005},"min":{"1min":0.217,"5min":0.217,"15min":0.193},"max":{"1min":2.3290000000000002,"5min":6.1120000000000001,"15min":12.529},"last":1.3660000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.52500000000000002,"15min":0.71999999999999997},"min":{"1min":0.26300000000000001,"5min":0.22800000000000001,"15min":0.184},"max":{"1min":3.0550000000000002,"5min":6.1779999999999999,"15min":20.491},"last":0.32200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5668728832,"data_stored":6960363026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9003773952,"data_stored":11042134827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3334791168,"data_stored":4081571097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:38:02.884 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:02.884 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:02.885 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:02.885 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:02.885 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:38:02.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:02.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:02.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:02.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:02.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:02.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:02.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:02.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:02.935+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:03.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:03.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:03.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:03.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:03.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:03.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:03.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:03.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:03.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:03.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:03.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:03.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:03.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:03.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:03.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:03.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:04.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:04.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:04.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:04.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:04.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:04.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:04.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:04.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:04.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:04.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:04.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:04.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:04.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.807+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:04.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:04.843+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:05.080 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:38:05.075+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:38:05.080 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:38:05.075+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:38:05.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:05.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:05.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:05.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:05.622 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:38:05.615+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:38:05.622 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:38:05.615+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:38:05.623 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:38:05.619+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:38:05.623 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:38:05.619+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:38:05.624 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:38:05.619+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:38:05.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:05.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:05.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:05.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:05.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:05.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:05.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:05.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:05.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:05.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:05.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:05.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:07.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:07.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:07.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:07.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:07.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:07.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:07.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:07.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:07.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:07.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:07.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:07.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:07.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:07.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:07.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:07.923+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:08.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:08.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:08.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:08.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:08.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:08.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:08.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:08.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:08.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:08.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:08.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:08.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:08.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:08.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:08.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:08.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:08.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:08.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:08.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:08.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:11.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:11.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:11.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:11.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:11.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.294+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:11.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:11.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:11.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:11.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:11.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:11.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:11.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:14.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:14.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:14.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:14.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:14.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:14.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:14.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:14.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:14.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:14.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:15.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:15.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:15.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:15.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:15.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:15.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:15.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:15.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:16.940 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:38:16.934+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:38:16.948 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:38:16.942+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:38:16.948 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:38:16.942+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:38:17.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:17.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:17.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:17.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:17.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:17.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:17.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:17.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:17.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:17.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:17.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:17.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:18.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:18.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:18.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:18.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:18.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:18.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:18.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:18.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:18.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:18.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:18.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:18.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:18.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:18.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:18.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.962+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:18.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:19.001 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:18.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:19.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:19.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:19.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:19.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:19.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:19.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:19.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:19.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:19.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:19.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:19.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:19.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:19.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:20.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:20.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:20.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:20.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:20.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:20.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:20.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:20.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:20.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:20.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:20.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:20.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:20.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:20.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:20.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:20.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:20.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:20.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:20.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:20.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:20.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:21.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:20.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:21.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:21.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:21.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:21.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:21.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:21.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:21.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:21.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:21.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:21.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:21.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:21.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:21.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:21.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:21.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:21.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:21.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:21.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:21.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:21.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:21.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:21.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:21.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:21.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:21.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:21.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:21.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:21.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:22.886 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:38:23.461 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:38:23.462 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:38:23.501 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2536,"stamp":"2023-09-23T08:38:22.518525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23387454795,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2336724,"num_read_kb":9192878,"num_write":2314793,"num_write_kb":9259543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8465,"num_omap_keys":137,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80458,"ondisk_log_size":80458,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23139408,"kb_used_data":17624420,"kb_used_omap":1583,"kb_used_meta":5513360,"kb_avail":259976112,"statfs":{"total":289910292480,"available":266215538688,"internally_reserved":0,"allocated":18047406080,"data_stored":22118434853,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1621841,"internal_metadata":5645680815},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,4,3,5,11,8,21,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12210176,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5445,"num_read_kb":21776,"num_write":5640,"num_write_kb":22560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001989"},"pg_stats":[{"pgid":"2.7","version":"88'287276","reported_seq":564624,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:38:21.345460+0000","last_change":"2023-09-23T08:30:48.043424+0000","last_active":"2023-09-23T08:38:21.345460+0000","last_peered":"2023-09-23T08:38:21.345460+0000","last_clean":"2023-09-23T08:38:21.345460+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:38:21.345460+0000","last_undegraded":"2023-09-23T08:38:21.345460+0000","last_fullsized":"2023-09-23T08:38:21.345460+0000","mapping_epoch":13,"log_start":"88'277211","ondisk_log_start":"88'277211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1194,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 453s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2756518223,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":276450,"num_read_kb":1087638,"num_write":272601,"num_write_kb":1090308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'316431","reported_seq":622215,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:38:21.281111+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:38:21.281111+0000","last_peered":"2023-09-23T08:38:21.281111+0000","last_clean":"2023-09-23T08:38:21.281111+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:38:21.281111+0000","last_undegraded":"2023-09-23T08:38:21.281111+0000","last_fullsized":"2023-09-23T08:38:21.281111+0000","mapping_epoch":13,"log_start":"88'306407","ondisk_log_start":"88'306407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":75,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 50s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3079528767,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":305848,"num_read_kb":1199210,"num_write":302480,"num_write_kb":1209689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'299164","reported_seq":587110,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:21.298576+0000","last_change":"2023-09-23T07:31:06.856647+0000","last_active":"2023-09-23T08:38:21.298576+0000","last_peered":"2023-09-23T08:38:21.298576+0000","last_clean":"2023-09-23T08:38:21.298576+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:38:21.298576+0000","last_undegraded":"2023-09-23T08:38:21.298576+0000","last_fullsized":"2023-09-23T08:38:21.298576+0000","mapping_epoch":13,"log_start":"88'289109","ondisk_log_start":"88'289109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":0,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2867527980,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":287225,"num_read_kb":1129981,"num_write":285239,"num_write_kb":1140869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'304763","reported_seq":609413,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:38:21.258002+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:38:21.258002+0000","last_peered":"2023-09-23T08:38:21.258002+0000","last_clean":"2023-09-23T08:38:21.258002+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:38:21.258002+0000","last_undegraded":"2023-09-23T08:38:21.258002+0000","last_fullsized":"2023-09-23T08:38:21.258002+0000","mapping_epoch":13,"log_start":"88'294710","ondisk_log_start":"88'294710","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":724,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 385s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3068649754,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":305145,"num_read_kb":1206487,"num_write":303512,"num_write_kb":1213961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'297355","reported_seq":593260,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:20.190076+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:38:20.190076+0000","last_peered":"2023-09-23T08:38:20.190076+0000","last_clean":"2023-09-23T08:38:20.190076+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:38:20.190076+0000","last_undegraded":"2023-09-23T08:38:20.190076+0000","last_fullsized":"2023-09-23T08:38:20.190076+0000","mapping_epoch":13,"log_start":"88'287309","ondisk_log_start":"88'287309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2961150270,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":295521,"num_read_kb":1162883,"num_write":293817,"num_write_kb":1175118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'307541","reported_seq":611348,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:21.335660+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:38:21.335660+0000","last_peered":"2023-09-23T08:38:21.335660+0000","last_clean":"2023-09-23T08:38:21.335660+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:38:21.335660+0000","last_undegraded":"2023-09-23T08:38:21.335660+0000","last_fullsized":"2023-09-23T08:38:21.335660+0000","mapping_epoch":13,"log_start":"88'297511","ondisk_log_start":"88'297511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3049927126,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":302925,"num_read_kb":1191116,"num_write":300510,"num_write_kb":1201920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'281178","reported_seq":559280,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:21.283645+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:38:21.283645+0000","last_peered":"2023-09-23T08:38:21.283645+0000","last_clean":"2023-09-23T08:38:21.283645+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:38:21.283645+0000","last_undegraded":"2023-09-23T08:38:21.283645+0000","last_fullsized":"2023-09-23T08:38:21.283645+0000","mapping_epoch":13,"log_start":"88'271108","ondisk_log_start":"88'271108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2765836589,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":277156,"num_read_kb":1089821,"num_write":274201,"num_write_kb":1096717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'297022","reported_seq":584187,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:21.298883+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:38:21.298883+0000","last_peered":"2023-09-23T08:38:21.298883+0000","last_clean":"2023-09-23T08:38:21.298883+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:38:21.298883+0000","last_undegraded":"2023-09-23T08:38:21.298883+0000","last_fullsized":"2023-09-23T08:38:21.298883+0000","mapping_epoch":13,"log_start":"88'287006","ondisk_log_start":"88'287006","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2837725718,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":286348,"num_read_kb":1125651,"num_write":282296,"num_write_kb":1129067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":264,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:34:29.307286+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:34:29.307286+0000","last_peered":"2023-09-23T08:34:29.307286+0000","last_clean":"2023-09-23T08:34:29.307286+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:34:29.307286+0000","last_undegraded":"2023-09-23T08:34:29.307286+0000","last_fullsized":"2023-09-23T08:34:29.307286+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23386864427,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2336618,"num_read_kb":9192787,"num_write":2314656,"num_write_kb":9257649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8465,"num_omap_keys":137,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18045890560,"data_stored":22117045846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80359,"ondisk_log_size":80359,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739349,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5210128,"kb_used_data":3263940,"kb_used_omap":319,"kb_used_meta":1945856,"kb_avail":89161712,"statfs":{"total":96636764160,"available":91301593088,"internally_reserved":0,"allocated":3342274560,"data_stored":4087642526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1992556780},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,0,1,3,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.81599999999999995,"15min":0.75900000000000001},"min":{"1min":0.22800000000000001,"5min":0.19400000000000001,"15min":0.17199999999999999},"max":{"1min":1.768,"5min":6.5510000000000002,"15min":10.922000000000001},"last":1.6140000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61299999999999999,"15min":0.70199999999999996},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.2309999999999999,"5min":6.4619999999999997,"15min":10.954000000000001},"last":1.5700000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.0009999999999999,"15min":0.98499999999999999},"min":{"1min":0.23899999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.6040000000000001,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":0.316},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0329999999999999,"15min":1.337},"min":{"1min":0.23100000000000001,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":6.2149999999999999,"5min":6.2149999999999999,"15min":14.311999999999999},"last":0.34000000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739336,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10582304,"kb_used_data":8812108,"kb_used_omap":796,"kb_used_meta":1769379,"kb_avail":83789536,"statfs":{"total":96636764160,"available":85800484864,"internally_reserved":0,"allocated":9023598592,"data_stored":11059290576,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":816126,"internal_metadata":1811844098},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,0,2,3,6,3,15,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":0.78500000000000003,"15min":0.89700000000000002},"min":{"1min":0.21099999999999999,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":8.1600000000000001,"5min":9.9459999999999997,"15min":21.216000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":1.956,"5min":1.107,"15min":1.46},"min":{"1min":0.20499999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":8.3670000000000009,"5min":10.022,"15min":21.388999999999999},"last":0.315}]},{"osd":2,"last update":"Sat Sep 23 08:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.84299999999999997,"15min":0.94499999999999995},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":3.4319999999999999,"5min":7.9909999999999997,"15min":26.117000000000001},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.71499999999999997,"15min":0.88800000000000001},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":3.4590000000000001,"5min":7.8170000000000002,"15min":26.151},"last":0.27900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359739344,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7346976,"kb_used_data":5548372,"kb_used_omap":467,"kb_used_meta":1798124,"kb_avail":87024864,"statfs":{"total":96636764160,"available":89113460736,"internally_reserved":0,"allocated":5681532928,"data_stored":6971501751,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":1841279937},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,0,2,4,2,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.121,"15min":1.012},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.17299999999999999},"max":{"1min":1.3680000000000001,"5min":7.3330000000000002,"15min":7.3330000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.167,"15min":1.1819999999999999},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":1.3999999999999999,"5min":7.3680000000000003,"15min":20.436},"last":0.34699999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.79500000000000004},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":1.7090000000000001,"5min":5.9390000000000001,"15min":12.529},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.496,"15min":0.65100000000000002},"min":{"1min":0.25,"5min":0.22800000000000001,"15min":0.184},"max":{"1min":1.044,"5min":6.1779999999999999,"15min":12.388},"last":0.317}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5680955392,"data_stored":6970791442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9023275008,"data_stored":11058797355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3341660160,"data_stored":4087457049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:38:23.503 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:23.503 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:23.503 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:23.503 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:23.504 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:38:30.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:30.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:30.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:30.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:30.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:30.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:30.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:30.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:30.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:30.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:30.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:30.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:30.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:30.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:30.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:30.994 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:30.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:30.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:31.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:31.006+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:31.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:31.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:31.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:31.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:31.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:31.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:31.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:31.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:31.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:31.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:31.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:31.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:33.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:33.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:33.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:33.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:33.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:33.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:33.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:33.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:33.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:33.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:33.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:33.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:33.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:33.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:33.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:33.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:35.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:35.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:35.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:35.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:35.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:35.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:35.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:35.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:35.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:35.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:35.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:35.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:35.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:36.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:36.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:36.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:36.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:36.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:36.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:36.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:36.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:36.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:36.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:36.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:36.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:37.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:37.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:37.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:37.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:37.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:37.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:37.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:37.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:37.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:37.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:37.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:37.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:37.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:37.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:37.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:37.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:37.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:37.836 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:37.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:37.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:38.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:38.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:38.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:38.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:38.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:38.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:38.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:38.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:38.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:38.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:38.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:38.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:38.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:38.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:38.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:38.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:38.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:38.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:38.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:38.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:38.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:38.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:38.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:38.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:38.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:39.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:39.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:39.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:39.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:39.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:39.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:39.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:39.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:39.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:39.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:39.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:39.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:39.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:42.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:42.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:42.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:42.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:42.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:42.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:42.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:42.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:42.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:42.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:42.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:42.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:42.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:42.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:43.505 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:38:44.395 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:38:44.395 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:38:44.432 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2546,"stamp":"2023-09-23T08:38:42.526886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23403134283,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2343843,"num_read_kb":9221346,"num_write":2322111,"num_write_kb":9288815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80481,"ondisk_log_size":80481,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22769008,"kb_used_data":17659088,"kb_used_omap":1583,"kb_used_meta":5108304,"kb_avail":260346512,"statfs":{"total":289910292480,"available":266594828288,"internally_reserved":0,"allocated":18082906112,"data_stored":22149019685,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1621841,"internal_metadata":5230903471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,1,6,7,11,11,21,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11575296,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5219,"num_read_kb":20872,"num_write":5352,"num_write_kb":21408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006793"},"pg_stats":[{"pgid":"2.7","version":"88'288233","reported_seq":566408,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:41.972173+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:38:41.972173+0000","last_peered":"2023-09-23T08:38:41.972173+0000","last_clean":"2023-09-23T08:38:41.972173+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:38:41.972173+0000","last_undegraded":"2023-09-23T08:38:41.972173+0000","last_fullsized":"2023-09-23T08:38:41.972173+0000","mapping_epoch":13,"log_start":"88'278211","ondisk_log_start":"88'278211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2758451535,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":277264,"num_read_kb":1090894,"num_write":273505,"num_write_kb":1093924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'317497","reported_seq":624220,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:38:41.906299+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:38:41.906299+0000","last_peered":"2023-09-23T08:38:41.906299+0000","last_clean":"2023-09-23T08:38:41.906299+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:38:41.906299+0000","last_undegraded":"2023-09-23T08:38:41.906299+0000","last_fullsized":"2023-09-23T08:38:41.906299+0000","mapping_epoch":13,"log_start":"88'307407","ondisk_log_start":"88'307407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":140,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 70s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3081707839,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":306759,"num_read_kb":1202854,"num_write":303468,"num_write_kb":1213641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'300119","reported_seq":588966,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:38:41.925992+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:38:41.925992+0000","last_peered":"2023-09-23T08:38:41.925992+0000","last_clean":"2023-09-23T08:38:41.925992+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:38:41.925992+0000","last_undegraded":"2023-09-23T08:38:41.925992+0000","last_fullsized":"2023-09-23T08:38:41.925992+0000","mapping_epoch":13,"log_start":"88'290109","ondisk_log_start":"88'290109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":56,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 19s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2869281068,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":288101,"num_read_kb":1133485,"num_write":286111,"num_write_kb":1144357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'305782","reported_seq":611383,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:38:41.914611+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:38:41.914611+0000","last_peered":"2023-09-23T08:38:41.914611+0000","last_clean":"2023-09-23T08:38:41.914611+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:38:41.914611+0000","last_undegraded":"2023-09-23T08:38:41.914611+0000","last_fullsized":"2023-09-23T08:38:41.914611+0000","mapping_epoch":13,"log_start":"88'295710","ondisk_log_start":"88'295710","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":781,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 406s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3070751002,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":306084,"num_read_kb":1210239,"num_write":304497,"num_write_kb":1217901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'298268","reported_seq":595082,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:40.452855+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:38:40.452855+0000","last_peered":"2023-09-23T08:38:40.452855+0000","last_clean":"2023-09-23T08:38:40.452855+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:38:40.452855+0000","last_undegraded":"2023-09-23T08:38:40.452855+0000","last_fullsized":"2023-09-23T08:38:40.452855+0000","mapping_epoch":13,"log_start":"88'288209","ondisk_log_start":"88'288209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2963128638,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":296422,"num_read_kb":1166487,"num_write":294724,"num_write_kb":1178746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'308382","reported_seq":613144,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:41.401881+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:38:41.401881+0000","last_peered":"2023-09-23T08:38:41.401881+0000","last_clean":"2023-09-23T08:38:41.401881+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:38:41.401881+0000","last_undegraded":"2023-09-23T08:38:41.401881+0000","last_fullsized":"2023-09-23T08:38:41.401881+0000","mapping_epoch":13,"log_start":"88'298311","ondisk_log_start":"88'298311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3051782614,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":303868,"num_read_kb":1194884,"num_write":301351,"num_write_kb":1205284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'282048","reported_seq":561012,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:41.405330+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:38:41.405330+0000","last_peered":"2023-09-23T08:38:41.405330+0000","last_clean":"2023-09-23T08:38:41.405330+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:38:41.405330+0000","last_undegraded":"2023-09-23T08:38:41.405330+0000","last_fullsized":"2023-09-23T08:38:41.405330+0000","mapping_epoch":13,"log_start":"88'272008","ondisk_log_start":"88'272008","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2767733037,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":278011,"num_read_kb":1093241,"num_write":275071,"num_write_kb":1100197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'298024","reported_seq":586086,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:41.903128+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:38:41.903128+0000","last_peered":"2023-09-23T08:38:41.903128+0000","last_clean":"2023-09-23T08:38:41.903128+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:38:41.903128+0000","last_undegraded":"2023-09-23T08:38:41.903128+0000","last_fullsized":"2023-09-23T08:38:41.903128+0000","mapping_epoch":13,"log_start":"88'288006","ondisk_log_start":"88'288006","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2839708182,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":287228,"num_read_kb":1129171,"num_write":283247,"num_write_kb":1132871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":265,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:33.126743+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:36:33.126743+0000","last_peered":"2023-09-23T08:36:33.126743+0000","last_clean":"2023-09-23T08:36:33.126743+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:36:33.126743+0000","last_undegraded":"2023-09-23T08:36:33.126743+0000","last_fullsized":"2023-09-23T08:36:33.126743+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23402543915,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2343737,"num_read_kb":9221255,"num_write":2321974,"num_write_kb":9286921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18082168832,"data_stored":22148318806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80382,"ondisk_log_size":80382,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739353,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4598636,"kb_used_data":3270244,"kb_used_omap":319,"kb_used_meta":1328064,"kb_avail":89773204,"statfs":{"total":96636764160,"available":91927760896,"internally_reserved":0,"allocated":3348729856,"data_stored":4093176222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1359937772},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,1,2,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:38:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":0.875,"15min":0.80800000000000005},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.17199999999999999},"max":{"1min":7.3879999999999999,"5min":7.3879999999999999,"15min":10.922000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.65800000000000003,"15min":0.70899999999999996},"min":{"1min":0.24399999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":10.954000000000001},"last":0.33700000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95199999999999996,"15min":0.97799999999999998},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.1879999999999997,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.98299999999999998,"15min":1.343},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.19800000000000001},"max":{"1min":4.407,"5min":6.2149999999999999,"15min":14.311999999999999},"last":4.1429999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739340,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10731520,"kb_used_data":8829488,"kb_used_omap":796,"kb_used_meta":1901219,"kb_avail":83640320,"statfs":{"total":96636764160,"available":85647687680,"internally_reserved":0,"allocated":9041395712,"data_stored":11074634192,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":816126,"internal_metadata":1946848258},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,5,4,4,8,15],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":0.78500000000000003,"15min":0.89700000000000002},"min":{"1min":0.21099999999999999,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":8.1600000000000001,"5min":9.9459999999999997,"15min":21.216000000000001},"last":0.248},{"interface":"front","average":{"1min":1.956,"5min":1.107,"15min":1.46},"min":{"1min":0.20499999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":8.3670000000000009,"5min":10.022,"15min":21.388999999999999},"last":1.6579999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.84299999999999997,"15min":0.94499999999999995},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":3.4319999999999999,"5min":7.9909999999999997,"15min":26.117000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.71499999999999997,"15min":0.88800000000000001},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":3.4590000000000001,"5min":7.8170000000000002,"15min":26.151},"last":0.307}]}]},{"osd":0,"up_from":8,"seq":34359739348,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7438852,"kb_used_data":5559356,"kb_used_omap":467,"kb_used_meta":1879020,"kb_avail":86932988,"statfs":{"total":96636764160,"available":89019379712,"internally_reserved":0,"allocated":5692780544,"data_stored":6981209271,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":1924117441},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,2,5,2,6,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:38:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.224,"15min":1.0509999999999999},"min":{"1min":0.20399999999999999,"5min":0.186,"15min":0.17299999999999999},"max":{"1min":17.216000000000001,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.272,"15min":1.151},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":17.251000000000001,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.79500000000000004},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":1.7090000000000001,"5min":5.9390000000000001,"15min":12.529},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.496,"15min":0.65100000000000002},"min":{"1min":0.25,"5min":0.22800000000000001,"15min":0.184},"max":{"1min":1.044,"5min":6.1779999999999999,"15min":12.388},"last":0.32400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5692334080,"data_stored":6980630034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9041666048,"data_stored":11074652971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3348168704,"data_stored":4093035801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:38:44.433 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:44.434 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:44.434 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:38:44.434 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:38:46.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:46.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:46.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:46.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:46.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:46.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:46.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:46.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:46.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:46.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:38:46.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:46.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:46.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:46.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:46.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:46.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:46.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:46.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:49.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:49.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:49.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:49.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:49.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:49.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:49.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:49.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:49.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:49.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:49.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:49.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:49.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:49.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:49.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:49.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:49.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:49.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:49.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:49.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:49.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:49.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:49.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:50.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:50.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:50.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:50.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:50.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:50.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:50.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:50.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:50.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:50.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:50.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:50.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:50.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:50.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:50.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:50.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:50.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:50.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:50.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:50.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:51.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:51.346 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:51.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:51.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:51.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:51.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:51.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:51.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:51.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:51.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:51.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:51.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:51.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:51.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:51.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:51.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:51.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:52.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:52.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:52.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:52.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:52.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:52.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:52.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:52.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:52.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:52.506+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:52.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:52.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:52.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:52.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:52.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:52.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:52.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:52.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:55.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:55.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:55.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:55.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:55.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:55.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:55.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:55.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:55.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:55.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:55.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:55.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:55.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:55.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:55.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:55.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:55.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:55.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:55.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:55.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:56.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:56.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:56.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.438+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:56.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:56.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:56.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:56.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:56.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:38:56.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:56.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:56.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:56.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:56.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:56.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:56.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:56.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:56.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:56.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:56.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:57.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:57.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:57.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:57.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:57.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:57.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:57.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:57.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:38:57.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:57.862 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:57.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:57.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:57.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:57.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:57.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:57.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:57.946+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:59.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:38:59.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:59.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:59.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:59.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:38:59.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:59.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:59.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:59.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:38:59.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:38:59.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:38:59.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:38:59.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:38:59.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:38:59.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:38:59.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:38:59.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:03.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:03.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:03.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:03.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:03.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:03.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:03.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:03.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:03.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:03.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:03.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:03.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:03.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:03.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:03.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:03.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:03.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:03.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:03.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:03.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:04.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:39:05.447 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:39:05.447 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:39:05.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:05.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:05.489 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2557,"stamp":"2023-09-23T08:39:04.533397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23419370827,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2351610,"num_read_kb":9252406,"num_write":2329801,"num_write_kb":9319575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80520,"ondisk_log_size":80520,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23074700,"kb_used_data":17696304,"kb_used_omap":1583,"kb_used_meta":5376784,"kb_avail":260040820,"statfs":{"total":289910292480,"available":266281799680,"internally_reserved":0,"allocated":18121015296,"data_stored":22181529637,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1621841,"internal_metadata":5505826991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,5,1,2,12,41,11,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8142848,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3907,"num_read_kb":15628,"num_write":3843,"num_write_kb":15372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004100"},"pg_stats":[{"pgid":"2.7","version":"88'289200","reported_seq":568297,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:02.845037+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:39:02.845037+0000","last_peered":"2023-09-23T08:39:02.845037+0000","last_clean":"2023-09-23T08:39:02.845037+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:39:02.845037+0000","last_undegraded":"2023-09-23T08:39:02.845037+0000","last_fullsized":"2023-09-23T08:39:02.845037+0000","mapping_epoch":13,"log_start":"88'279111","ondisk_log_start":"88'279111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2760261967,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":278171,"num_read_kb":1094518,"num_write":274418,"num_write_kb":1097576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'318623","reported_seq":626368,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:39:02.786749+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:39:02.786749+0000","last_peered":"2023-09-23T08:39:02.786749+0000","last_clean":"2023-09-23T08:39:02.786749+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:39:02.786749+0000","last_undegraded":"2023-09-23T08:39:02.786749+0000","last_fullsized":"2023-09-23T08:39:02.786749+0000","mapping_epoch":13,"log_start":"88'308607","ondisk_log_start":"88'308607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":199,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 91s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3083972927,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":307767,"num_read_kb":1206886,"num_write":304501,"num_write_kb":1217773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'301135","reported_seq":590953,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:39:02.684983+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:39:02.684983+0000","last_peered":"2023-09-23T08:39:02.684983+0000","last_clean":"2023-09-23T08:39:02.684983+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:39:02.684983+0000","last_undegraded":"2023-09-23T08:39:02.684983+0000","last_fullsized":"2023-09-23T08:39:02.684983+0000","mapping_epoch":13,"log_start":"88'291109","ondisk_log_start":"88'291109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":103,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 39s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2871238956,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":289050,"num_read_kb":1137281,"num_write":287049,"num_write_kb":1148109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'306830","reported_seq":613512,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:39:02.724575+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:39:02.724575+0000","last_peered":"2023-09-23T08:39:02.724575+0000","last_clean":"2023-09-23T08:39:02.724575+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:39:02.724575+0000","last_undegraded":"2023-09-23T08:39:02.724575+0000","last_fullsized":"2023-09-23T08:39:02.724575+0000","mapping_epoch":13,"log_start":"88'296810","ondisk_log_start":"88'296810","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":817,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 426s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3072979226,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":307156,"num_read_kb":1214527,"num_write":305523,"num_write_kb":1222005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'299205","reported_seq":596999,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:00.614003+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:39:00.614003+0000","last_peered":"2023-09-23T08:39:00.614003+0000","last_clean":"2023-09-23T08:39:00.614003+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:39:00.614003+0000","last_undegraded":"2023-09-23T08:39:00.614003+0000","last_fullsized":"2023-09-23T08:39:00.614003+0000","mapping_epoch":13,"log_start":"88'289109","ondisk_log_start":"88'289109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2965012798,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":297393,"num_read_kb":1170367,"num_write":295649,"num_write_kb":1182446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'309401","reported_seq":615120,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:01.533726+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:39:01.533726+0000","last_peered":"2023-09-23T08:39:01.533726+0000","last_clean":"2023-09-23T08:39:01.533726+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:39:01.533726+0000","last_undegraded":"2023-09-23T08:39:01.533726+0000","last_fullsized":"2023-09-23T08:39:01.533726+0000","mapping_epoch":13,"log_start":"88'299311","ondisk_log_start":"88'299311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3053982166,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":304815,"num_read_kb":1198672,"num_write":302352,"num_write_kb":1209288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'282985","reported_seq":562878,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:01.517685+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:39:01.517685+0000","last_peered":"2023-09-23T08:39:01.517685+0000","last_clean":"2023-09-23T08:39:01.517685+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:39:01.517685+0000","last_undegraded":"2023-09-23T08:39:01.517685+0000","last_fullsized":"2023-09-23T08:39:01.517685+0000","mapping_epoch":13,"log_start":"88'272908","ondisk_log_start":"88'272908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2769756461,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":278923,"num_read_kb":1096889,"num_write":275990,"num_write_kb":1103873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'299013","reported_seq":588085,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:02.732004+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:39:02.732004+0000","last_peered":"2023-09-23T08:39:02.732004+0000","last_clean":"2023-09-23T08:39:02.732004+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:39:02.732004+0000","last_undegraded":"2023-09-23T08:39:02.732004+0000","last_fullsized":"2023-09-23T08:39:02.732004+0000","mapping_epoch":13,"log_start":"88'289006","ondisk_log_start":"88'289006","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2841575958,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":288229,"num_read_kb":1133175,"num_write":284182,"num_write_kb":1136611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":265,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:33.126743+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:36:33.126743+0000","last_peered":"2023-09-23T08:36:33.126743+0000","last_clean":"2023-09-23T08:36:33.126743+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:36:33.126743+0000","last_undegraded":"2023-09-23T08:36:33.126743+0000","last_fullsized":"2023-09-23T08:36:33.126743+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23418780459,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2351504,"num_read_kb":9252315,"num_write":2329664,"num_write_kb":9317681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18119991296,"data_stored":22180558422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80421,"ondisk_log_size":80421,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739357,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4637548,"kb_used_data":3277216,"kb_used_omap":319,"kb_used_meta":1360000,"kb_avail":89734292,"statfs":{"total":96636764160,"available":91887915008,"internally_reserved":0,"allocated":3355869184,"data_stored":4099361182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1392640236},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:38:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":0.875,"15min":0.80800000000000005},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.17199999999999999},"max":{"1min":7.3879999999999999,"5min":7.3879999999999999,"15min":10.922000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.65800000000000003,"15min":0.70899999999999996},"min":{"1min":0.24399999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":10.954000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95199999999999996,"15min":0.97799999999999998},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.1879999999999997,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.98299999999999998,"15min":1.343},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.19800000000000001},"max":{"1min":4.407,"5min":6.2149999999999999,"15min":14.311999999999999},"last":0.34499999999999997}]}]},{"osd":1,"up_from":8,"seq":34359739344,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10896932,"kb_used_data":8848540,"kb_used_omap":796,"kb_used_meta":2047587,"kb_avail":83474908,"statfs":{"total":96636764160,"available":85478305792,"internally_reserved":0,"allocated":9060904960,"data_stored":11091259856,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":816126,"internal_metadata":2096729090},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1,2,9,40,10,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:38:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":0.78500000000000003,"15min":0.89700000000000002},"min":{"1min":0.21099999999999999,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":8.1600000000000001,"5min":9.9459999999999997,"15min":21.216000000000001},"last":2.4670000000000001},{"interface":"front","average":{"1min":1.956,"5min":1.107,"15min":1.46},"min":{"1min":0.20499999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":8.3670000000000009,"5min":10.022,"15min":21.388999999999999},"last":2.3119999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.84299999999999997,"15min":0.94499999999999995},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":3.4319999999999999,"5min":7.9909999999999997,"15min":26.117000000000001},"last":0.22},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.71499999999999997,"15min":0.88800000000000001},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":3.4590000000000001,"5min":7.8170000000000002,"15min":26.151},"last":0.254}]}]},{"osd":0,"up_from":8,"seq":34359739352,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7540220,"kb_used_data":5570548,"kb_used_omap":467,"kb_used_meta":1969196,"kb_avail":86831620,"statfs":{"total":96636764160,"available":88915578880,"internally_reserved":0,"allocated":5704241152,"data_stored":6990908599,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":2016457665},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,0,0,3,1,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:38:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.224,"15min":1.0509999999999999},"min":{"1min":0.20399999999999999,"5min":0.186,"15min":0.17299999999999999},"max":{"1min":17.216000000000001,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.272,"15min":1.151},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":17.251000000000001,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.29399999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.79500000000000004},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":1.7090000000000001,"5min":5.9390000000000001,"15min":12.529},"last":0.221},{"interface":"front","average":{"1min":0.433,"5min":0.496,"15min":0.65100000000000002},"min":{"1min":0.25,"5min":0.22800000000000001,"15min":0.184},"max":{"1min":1.044,"5min":6.1779999999999999,"15min":12.388},"last":0.35299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5703872512,"data_stored":6990386706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9060868096,"data_stored":11091004203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3355250688,"data_stored":4099167513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:39:05.491 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:39:05.491 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:39:05.491 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:39:05.492 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:39:05.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:05.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:05.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:05.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:05.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:05.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:05.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:05.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:05.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:05.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:06.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:06.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:06.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:06.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:06.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:06.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:06.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:06.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:06.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:06.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:06.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:06.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:09.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:09.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:09.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:09.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:09.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:09.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:09.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:09.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:09.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:39:09.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:09.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:09.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:09.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:09.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:09.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:09.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:09.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.478+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:09.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:09.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:09.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:09.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:09.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:09.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:09.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:09.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:09.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:09.886 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:39:09.882+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:39:09.887 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:39:09.882+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:39:10.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:10.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:10.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:10.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:10.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:10.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:10.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:10.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:10.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:10.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:10.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:10.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:10.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:10.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:10.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:10.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:11.757 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:39:11.754+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:39:11.757 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:39:11.754+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:39:11.758 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:39:11.754+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:39:12.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:12.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:12.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:12.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:12.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:12.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:12.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:12.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:12.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:12.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:12.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:12.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:12.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:12.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:13.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:39:13.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:13.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:13.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:13.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:13.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:13.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:13.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:13.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:13.868 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:13.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:13.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:16.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:16.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:16.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:16.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:16.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:16.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:16.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:16.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:17.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:17.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:17.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:17.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:17.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:17.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:17.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:17.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:17.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:17.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:17.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:17.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:17.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:21.422 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:39:21.417+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:39:21.435 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:39:21.425+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:39:21.435 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:39:21.425+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:39:22.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:22.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:22.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:22.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:22.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:22.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:22.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:22.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:22.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:22.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:22.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:22.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:22.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:22.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:22.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:22.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:23.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:23.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:23.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:23.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:23.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:23.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:23.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:23.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:23.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:23.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:23.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:23.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:23.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:23.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:23.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:23.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:23.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:23.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:23.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:23.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:24.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:24.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:24.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:24.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:24.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:24.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:24.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:24.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:39:24.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:24.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:24.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:24.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:24.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:24.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:24.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:24.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:24.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:24.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:24.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:24.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:25.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:39:25.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:25.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:25.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:25.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:25.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:25.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:25.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:25.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:25.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:25.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:25.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:25.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:25.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:39:26.926 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:39:26.926 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:39:26.957 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2568,"stamp":"2023-09-23T08:39:26.542582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23436635467,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2359523,"num_read_kb":9284034,"num_write":2337788,"num_write_kb":9351523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80466,"ondisk_log_size":80466,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23470372,"kb_used_data":17736900,"kb_used_omap":1583,"kb_used_meta":5731856,"kb_avail":259645148,"statfs":{"total":289910292480,"available":265876631552,"internally_reserved":0,"allocated":18162585600,"data_stored":22217320485,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1621841,"internal_metadata":5869420719},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,6,7,14,18,14],"upper_bound":256},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8982528,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4079,"num_read_kb":16300,"num_write":4142,"num_write_kb":16568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006978"},"pg_stats":[{"pgid":"2.7","version":"88'290184","reported_seq":570246,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:23.450293+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:39:23.450293+0000","last_peered":"2023-09-23T08:39:23.450293+0000","last_clean":"2023-09-23T08:39:23.450293+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:39:23.450293+0000","last_undegraded":"2023-09-23T08:39:23.450293+0000","last_fullsized":"2023-09-23T08:39:23.450293+0000","mapping_epoch":13,"log_start":"88'280111","ondisk_log_start":"88'280111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2762277199,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":279121,"num_read_kb":1098310,"num_write":275363,"num_write_kb":1101356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'319681","reported_seq":628502,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:39:23.436572+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:39:23.436572+0000","last_peered":"2023-09-23T08:39:23.436572+0000","last_clean":"2023-09-23T08:39:23.436572+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:39:23.436572+0000","last_undegraded":"2023-09-23T08:39:23.436572+0000","last_fullsized":"2023-09-23T08:39:23.436572+0000","mapping_epoch":13,"log_start":"88'309607","ondisk_log_start":"88'309607","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":242,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 112s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3086233919,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":308820,"num_read_kb":1211098,"num_write":305494,"num_write_kb":1221745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'302138","reported_seq":592860,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:39:23.428335+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:39:23.428335+0000","last_peered":"2023-09-23T08:39:23.428335+0000","last_clean":"2023-09-23T08:39:23.428335+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:39:23.428335+0000","last_undegraded":"2023-09-23T08:39:23.428335+0000","last_fullsized":"2023-09-23T08:39:23.428335+0000","mapping_epoch":13,"log_start":"88'292109","ondisk_log_start":"88'292109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":148,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 60s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2873327916,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":289936,"num_read_kb":1140825,"num_write":287988,"num_write_kb":1151865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'307818","reported_seq":615501,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:39:23.409567+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:39:23.409567+0000","last_peered":"2023-09-23T08:39:23.409567+0000","last_clean":"2023-09-23T08:39:23.409567+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:39:23.409567+0000","last_undegraded":"2023-09-23T08:39:23.409567+0000","last_fullsized":"2023-09-23T08:39:23.409567+0000","mapping_epoch":13,"log_start":"88'297810","ondisk_log_start":"88'297810","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":861,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 447s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3074990362,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":308148,"num_read_kb":1218491,"num_write":306485,"num_write_kb":1225853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'300445","reported_seq":599448,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:25.867895+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:39:25.867895+0000","last_peered":"2023-09-23T08:39:25.867895+0000","last_clean":"2023-09-23T08:39:25.867895+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:39:25.867895+0000","last_undegraded":"2023-09-23T08:39:25.867895+0000","last_fullsized":"2023-09-23T08:39:25.867895+0000","mapping_epoch":13,"log_start":"88'290409","ondisk_log_start":"88'290409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2967667006,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":298593,"num_read_kb":1175167,"num_write":296887,"num_write_kb":1187398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'310416","reported_seq":617146,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:21.617139+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:39:21.617139+0000","last_peered":"2023-09-23T08:39:21.617139+0000","last_clean":"2023-09-23T08:39:21.617139+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:39:21.617139+0000","last_undegraded":"2023-09-23T08:39:21.617139+0000","last_fullsized":"2023-09-23T08:39:21.617139+0000","mapping_epoch":13,"log_start":"88'300411","ondisk_log_start":"88'300411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3056185814,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":305812,"num_read_kb":1202660,"num_write":303355,"num_write_kb":1213300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'283886","reported_seq":564688,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:21.630422+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:39:21.630422+0000","last_peered":"2023-09-23T08:39:21.630422+0000","last_clean":"2023-09-23T08:39:21.630422+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:39:21.630422+0000","last_undegraded":"2023-09-23T08:39:21.630422+0000","last_fullsized":"2023-09-23T08:39:21.630422+0000","mapping_epoch":13,"log_start":"88'273808","ondisk_log_start":"88'273808","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2771685677,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":279819,"num_read_kb":1100465,"num_write":276879,"num_write_kb":1107429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'300070","reported_seq":590096,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:23.410734+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:39:23.410734+0000","last_peered":"2023-09-23T08:39:23.410734+0000","last_clean":"2023-09-23T08:39:23.410734+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:39:23.410734+0000","last_undegraded":"2023-09-23T08:39:23.410734+0000","last_fullsized":"2023-09-23T08:39:23.410734+0000","mapping_epoch":13,"log_start":"88'290006","ondisk_log_start":"88'290006","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2843677206,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":289168,"num_read_kb":1136927,"num_write":285200,"num_write_kb":1140683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":265,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:33.126743+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:36:33.126743+0000","last_peered":"2023-09-23T08:36:33.126743+0000","last_clean":"2023-09-23T08:36:33.126743+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:36:33.126743+0000","last_undegraded":"2023-09-23T08:36:33.126743+0000","last_fullsized":"2023-09-23T08:36:33.126743+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23436045099,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2359417,"num_read_kb":9283943,"num_write":2337651,"num_write_kb":9349629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18161225728,"data_stored":22216054358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80367,"ondisk_log_size":80367,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739361,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4693036,"kb_used_data":3284132,"kb_used_omap":319,"kb_used_meta":1408576,"kb_avail":89678804,"statfs":{"total":96636764160,"available":91831095296,"internally_reserved":0,"allocated":3362951168,"data_stored":4105484702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1442382060},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,2,3,3,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:38:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":0.875,"15min":0.80800000000000005},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.17199999999999999},"max":{"1min":7.3879999999999999,"5min":7.3879999999999999,"15min":10.922000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.65800000000000003,"15min":0.70899999999999996},"min":{"1min":0.24399999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":10.954000000000001},"last":0.25800000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95199999999999996,"15min":0.97799999999999998},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.1879999999999997,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.98299999999999998,"15min":1.343},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.19800000000000001},"max":{"1min":4.407,"5min":6.2149999999999999,"15min":14.311999999999999},"last":0.40799999999999997}]}]},{"osd":1,"up_from":8,"seq":34359739348,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11106264,"kb_used_data":8867912,"kb_used_omap":796,"kb_used_meta":2237539,"kb_avail":83265576,"statfs":{"total":96636764160,"available":85263949824,"internally_reserved":0,"allocated":9080741888,"data_stored":11108344272,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":816126,"internal_metadata":2291239938},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,3,8,9,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.76400000000000001,"15min":0.90200000000000002},"min":{"1min":0.22900000000000001,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":2.4670000000000001,"5min":9.9459999999999997,"15min":21.216000000000001},"last":0.37},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.397},"min":{"1min":0.189,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":4.4489999999999998,"5min":10.022,"15min":21.388999999999999},"last":4.7809999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.67500000000000004,"15min":0.92700000000000005},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.329,"5min":7.9909999999999997,"15min":26.117000000000001},"last":3.4769999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73699999999999999,"15min":0.90600000000000003},"min":{"1min":0.254,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":3.665,"5min":7.8170000000000002,"15min":26.151},"last":0.32900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739357,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7671072,"kb_used_data":5584856,"kb_used_omap":467,"kb_used_meta":2085740,"kb_avail":86700768,"statfs":{"total":96636764160,"available":88781586432,"internally_reserved":0,"allocated":5718892544,"data_stored":7003491511,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":2135798721},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,0,2,3,6,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:38:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.224,"15min":1.0509999999999999},"min":{"1min":0.20399999999999999,"5min":0.186,"15min":0.17299999999999999},"max":{"1min":17.216000000000001,"5min":17.216000000000001,"15min":17.216000000000001},"last":2.794},{"interface":"front","average":{"1min":1.506,"5min":1.272,"15min":1.151},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":17.251000000000001,"5min":17.251000000000001,"15min":17.251000000000001},"last":2.8239999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.76000000000000001},"min":{"1min":0.221,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":4.0570000000000004,"5min":5.9390000000000001,"15min":12.529},"last":2.7469999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.48499999999999999,"15min":0.65100000000000002},"min":{"1min":0.24099999999999999,"5min":0.22800000000000001,"15min":0.184},"max":{"1min":0.52600000000000002,"5min":6.1779999999999999,"15min":12.388},"last":2.859}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5718605824,"data_stored":7003039250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9080279040,"data_stored":11107711787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3362340864,"data_stored":4105303321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:39:26.959 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:39:26.959 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:39:26.959 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:39:26.959 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:39:27.346 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:39:27.341+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:39:27.346 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:39:27.341+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:39:27.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:27.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:27.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:27.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:27.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:27.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:27.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:27.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:27.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:27.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:27.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:27.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:27.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:27.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:27.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:28.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:28.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:28.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:28.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:28.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:28.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:28.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:28.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:28.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:28.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:29.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:29.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:29.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:29.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:29.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:29.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:29.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:29.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:29.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:39:29.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:29.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:29.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:29.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:29.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:29.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:29.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:29.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:29.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:29.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:29.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:34.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:34.413+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:34.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:34.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:34.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:34.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:34.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:34.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:34.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:34.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:34.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:34.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:34.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:34.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:34.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:34.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:34.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:34.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:36.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:36.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:36.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:36.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:36.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:36.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:36.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:36.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:36.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:36.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:36.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:36.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:36.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:36.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:36.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:36.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:37.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:37.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:37.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:37.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:37.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:37.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:37.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:37.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:37.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:37.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:37.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:37.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:37.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:37.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:38.853 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:39:38.849+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:39:39.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:39.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:39.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:39.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:39.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:39.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:39.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:39.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:39.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:39.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:39.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:39.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:39.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:39.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:39.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:39.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:39.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:39.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:39.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:39.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:41.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:41.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:41.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:41.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:41.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:41.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:41.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:41.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:41.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:41.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:41.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:41.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:41.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:41.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:41.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:41.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:42.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:42.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:42.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:42.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:42.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:42.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:42.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:42.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:42.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:42.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:42.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:42.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:42.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:42.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:44.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:44.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:44.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:44.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:44.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:44.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:44.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:44.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:44.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:44.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:44.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:44.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:45.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:44.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:45.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:45.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:45.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:45.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:46.961 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:39:47.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:47.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:47.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:47.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:47.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:47.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:47.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:47.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:47.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:47.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:47.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:47.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:47.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:47.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:47.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:47.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:47.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:47.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:47.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:47.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:39:47.961 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:39:47.986 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2578,"stamp":"2023-09-23T08:39:46.547861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23452773707,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2367210,"num_read_kb":9314754,"num_write":2345552,"num_write_kb":9382579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80599,"ondisk_log_size":80599,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23728944,"kb_used_data":17773076,"kb_used_omap":1583,"kb_used_meta":5954256,"kb_avail":259386576,"statfs":{"total":289910292480,"available":265611853824,"internally_reserved":0,"allocated":18199629824,"data_stored":22249916453,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1621841,"internal_metadata":6097158319},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,3,7,10,10,20],"upper_bound":256},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8683520,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4132,"num_read_kb":16516,"num_write":4120,"num_write_kb":16480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003980"},"pg_stats":[{"pgid":"2.7","version":"88'291179","reported_seq":572155,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:44.187851+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:39:44.187851+0000","last_peered":"2023-09-23T08:39:44.187851+0000","last_clean":"2023-09-23T08:39:44.187851+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:39:44.187851+0000","last_undegraded":"2023-09-23T08:39:44.187851+0000","last_fullsized":"2023-09-23T08:39:44.187851+0000","mapping_epoch":13,"log_start":"88'281111","ondisk_log_start":"88'281111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2764140879,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":280025,"num_read_kb":1101922,"num_write":276316,"num_write_kb":1105168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'320730","reported_seq":630596,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:39:44.161692+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:39:44.161692+0000","last_peered":"2023-09-23T08:39:44.161692+0000","last_clean":"2023-09-23T08:39:44.161692+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:39:44.161692+0000","last_undegraded":"2023-09-23T08:39:44.161692+0000","last_fullsized":"2023-09-23T08:39:44.161692+0000","mapping_epoch":13,"log_start":"88'310707","ondisk_log_start":"88'310707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":280,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 132s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3088453951,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":309846,"num_read_kb":1215190,"num_write":306480,"num_write_kb":1225689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'303173","reported_seq":594914,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:39:44.211215+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:39:44.211215+0000","last_peered":"2023-09-23T08:39:44.211215+0000","last_clean":"2023-09-23T08:39:44.211215+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:39:44.211215+0000","last_undegraded":"2023-09-23T08:39:44.211215+0000","last_fullsized":"2023-09-23T08:39:44.211215+0000","mapping_epoch":13,"log_start":"88'293110","ondisk_log_start":"88'293110","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":195,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 81s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2875195692,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":290931,"num_read_kb":1144805,"num_write":288952,"num_write_kb":1155721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'308864","reported_seq":617583,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:39:44.187018+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:39:44.187018+0000","last_peered":"2023-09-23T08:39:44.187018+0000","last_clean":"2023-09-23T08:39:44.187018+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:39:44.187018+0000","last_undegraded":"2023-09-23T08:39:44.187018+0000","last_fullsized":"2023-09-23T08:39:44.187018+0000","mapping_epoch":13,"log_start":"88'298810","ondisk_log_start":"88'298810","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":904,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 468s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3077058842,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":309178,"num_read_kb":1222607,"num_write":307505,"num_write_kb":1229933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'301398","reported_seq":601389,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:46.131405+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:39:46.131405+0000","last_peered":"2023-09-23T08:39:46.131405+0000","last_clean":"2023-09-23T08:39:46.131405+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:39:46.131405+0000","last_undegraded":"2023-09-23T08:39:46.131405+0000","last_fullsized":"2023-09-23T08:39:46.131405+0000","mapping_epoch":13,"log_start":"88'291309","ondisk_log_start":"88'291309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2969747774,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":299571,"num_read_kb":1179079,"num_write":297832,"num_write_kb":1191178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'311410","reported_seq":619112,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:41.742526+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:39:41.742526+0000","last_peered":"2023-09-23T08:39:41.742526+0000","last_clean":"2023-09-23T08:39:41.742526+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:39:41.742526+0000","last_undegraded":"2023-09-23T08:39:41.742526+0000","last_fullsized":"2023-09-23T08:39:41.742526+0000","mapping_epoch":13,"log_start":"88'301311","ondisk_log_start":"88'301311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3058352598,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":306771,"num_read_kb":1206492,"num_write":304340,"num_write_kb":1217240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'284838","reported_seq":566519,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:41.718563+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:39:41.718563+0000","last_peered":"2023-09-23T08:39:41.718563+0000","last_clean":"2023-09-23T08:39:41.718563+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:39:41.718563+0000","last_undegraded":"2023-09-23T08:39:41.718563+0000","last_fullsized":"2023-09-23T08:39:41.718563+0000","mapping_epoch":13,"log_start":"88'274808","ondisk_log_start":"88'274808","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2773520685,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":280686,"num_read_kb":1103933,"num_write":277822,"num_write_kb":1111201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'301080","reported_seq":592044,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:39:44.174616+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:39:44.174616+0000","last_peered":"2023-09-23T08:39:44.174616+0000","last_clean":"2023-09-23T08:39:44.174616+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:39:44.174616+0000","last_undegraded":"2023-09-23T08:39:44.174616+0000","last_fullsized":"2023-09-23T08:39:44.174616+0000","mapping_epoch":13,"log_start":"88'291006","ondisk_log_start":"88'291006","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2845712918,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":290096,"num_read_kb":1140635,"num_write":286168,"num_write_kb":1144555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":265,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:33.126743+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:36:33.126743+0000","last_peered":"2023-09-23T08:36:33.126743+0000","last_clean":"2023-09-23T08:36:33.126743+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:36:33.126743+0000","last_undegraded":"2023-09-23T08:36:33.126743+0000","last_fullsized":"2023-09-23T08:36:33.126743+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23452183339,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2367104,"num_read_kb":9314663,"num_write":2345415,"num_write_kb":9380685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18198585344,"data_stored":22248953430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80500,"ondisk_log_size":80500,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739365,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4727408,"kb_used_data":3290728,"kb_used_omap":319,"kb_used_meta":1436352,"kb_avail":89644432,"statfs":{"total":96636764160,"available":91795898368,"internally_reserved":0,"allocated":3369705472,"data_stored":4111448478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1470824684},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,5,5,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:39:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":0.84999999999999998,"15min":0.80100000000000005},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.17199999999999999},"max":{"1min":7.7039999999999997,"5min":7.7039999999999997,"15min":10.922000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":7.6520000000000001,"5min":7.9939999999999998,"15min":10.954000000000001},"last":0.219}]},{"osd":1,"last update":"Sat Sep 23 08:39:32 2023","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":0.97199999999999998,"15min":1.032},"min":{"1min":0.248,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":10.759,"5min":10.759,"15min":10.759},"last":2.9319999999999999},{"interface":"front","average":{"1min":1.595,"5min":1.0780000000000001,"15min":1.3220000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":12.379,"5min":12.379,"15min":14.311999999999999},"last":1.3819999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739352,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11220000,"kb_used_data":8885844,"kb_used_omap":796,"kb_used_meta":2333347,"kb_avail":83151840,"statfs":{"total":96636764160,"available":85147484160,"internally_reserved":0,"allocated":9099104256,"data_stored":11124498896,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":816126,"internal_metadata":2389347330},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,2,5,4,5,13],"upper_bound":256},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.76400000000000001,"15min":0.90200000000000002},"min":{"1min":0.22900000000000001,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":2.4670000000000001,"5min":9.9459999999999997,"15min":21.216000000000001},"last":0.316},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.397},"min":{"1min":0.189,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":4.4489999999999998,"5min":10.022,"15min":21.388999999999999},"last":0.26700000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.67500000000000004,"15min":0.92700000000000005},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.329,"5min":7.9909999999999997,"15min":26.117000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73699999999999999,"15min":0.90600000000000003},"min":{"1min":0.254,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":3.665,"5min":7.8170000000000002,"15min":26.151},"last":0.35499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739361,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7781536,"kb_used_data":5596504,"kb_used_omap":467,"kb_used_meta":2184556,"kb_avail":86590304,"statfs":{"total":96636764160,"available":88668471296,"internally_reserved":0,"allocated":5730820096,"data_stored":7013969079,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":2236986305},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:39:27 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.163,"15min":1.0880000000000001},"min":{"1min":0.248,"5min":0.186,"15min":0.17299999999999999},"max":{"1min":3.972,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.21,"15min":1.1870000000000001},"min":{"1min":0.29399999999999998,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":4.0060000000000002,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.504}]},{"osd":2,"last update":"Sat Sep 23 08:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.76000000000000001},"min":{"1min":0.221,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":4.0570000000000004,"5min":5.9390000000000001,"15min":12.529},"last":0.252},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.48499999999999999,"15min":0.65100000000000002},"min":{"1min":0.24099999999999999,"5min":0.22800000000000001,"15min":0.184},"max":{"1min":0.52600000000000002,"5min":6.1779999999999999,"15min":12.388},"last":0.28299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5730238464,"data_stored":7013246482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9099186176,"data_stored":11124386603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3369160704,"data_stored":4111320345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:39:47.988 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:39:47.988 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:39:47.988 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:39:47.988 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:39:48.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:48.397 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:48.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:48.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:48.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:48.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:48.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:48.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:48.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:48.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:48.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:48.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:48.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:48.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:48.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:48.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:48.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:51.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:51.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:51.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:51.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:51.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:51.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:52.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:52.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:52.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:52.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:52.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:39:52.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:52.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:52.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:52.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:52.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:52.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:52.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:52.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:52.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:52.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:52.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:52.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:52.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.633+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:52.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:52.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:52.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:54.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:54.865+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:54.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:54.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:54.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:54.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:54.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:54.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:55.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:55.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:55.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:55.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:55.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:55.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:55.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:55.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:55.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:55.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:55.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:55.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:55.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:55.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:55.765 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:39:55.761+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:39:56.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:56.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:56.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:56.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:56.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:56.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:56.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:56.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:56.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:39:56.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:56.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:56.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:56.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:56.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:56.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:56.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:56.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:56.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:56.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:56.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:56.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:56.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:56.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:57.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:39:57.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:57.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:39:57.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:57.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:57.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:57.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:57.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:57.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:57.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:57.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:57.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:57.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:57.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:57.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:39:57.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:39:57.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:57.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.821+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:57.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:57.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:57.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:58.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:58.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:39:59.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:59.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:39:59.031 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:59.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:39:59.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:59.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:39:59.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:59.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:39:59.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:59.113+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:39:59.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:59.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:39:59.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:39:59.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:00.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:00.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:00.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:00.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:00.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:00.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:00.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:00.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:00.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:00.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:00.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:00.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:01.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:01.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:01.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:01.877+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:01.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:01.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:01.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:01.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:01.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:01.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:01.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:01.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:01.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:01.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:03.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:03.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:03.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:03.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:03.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:03.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:03.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:03.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:03.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:03.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:03.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:03.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:04.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:04.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:04.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:04.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:04.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:04.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:04.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:04.597+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:04.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:04.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:04.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:04.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:04.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:04.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:04.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:04.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:05.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:05.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:05.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:05.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:05.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:05.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:05.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:05.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:05.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:05.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:05.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:05.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:05.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:05.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:05.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:05.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:06.537 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:06.533+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:40:06.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:06.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:06.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:06.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:06.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:06.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:06.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:06.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:06.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:40:06.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:06.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:06.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:06.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:06.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:06.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:06.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:06.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:06.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:06.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:06.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:06.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:07.897 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:07.885+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:40:07.897 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:07.885+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:40:07.898 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:07.885+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:40:07.989 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:40:07.991 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:07.985+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:40:07.991 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:07.985+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:40:07.991 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:07.985+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:40:08.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:08.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:08.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:08.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:08.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:08.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:08.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:08.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:08.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:08.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:08.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:08.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:08.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:08.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:08.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:08.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:08.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:08.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:08.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:08.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:08.789 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:40:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:40:08.860 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2589,"stamp":"2023-09-23T08:40:08.551607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23469833547,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2375311,"num_read_kb":9347114,"num_write":2353636,"num_write_kb":9414915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80594,"ondisk_log_size":80594,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23746100,"kb_used_data":17811596,"kb_used_omap":1583,"kb_used_meta":5932880,"kb_avail":259369420,"statfs":{"total":289910292480,"available":265594286080,"internally_reserved":0,"allocated":18239074304,"data_stored":22284859429,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1621841,"internal_metadata":6075269295},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,3,3,4,11,13,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9113600,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4291,"num_read_kb":17148,"num_write":4247,"num_write_kb":16988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002096"},"pg_stats":[{"pgid":"2.7","version":"88'292144","reported_seq":574087,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:04.933286+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:40:04.933286+0000","last_peered":"2023-09-23T08:40:04.933286+0000","last_clean":"2023-09-23T08:40:04.933286+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:40:04.933286+0000","last_undegraded":"2023-09-23T08:40:04.933286+0000","last_fullsized":"2023-09-23T08:40:04.933286+0000","mapping_epoch":13,"log_start":"88'282111","ondisk_log_start":"88'282111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2766053711,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":280980,"num_read_kb":1105734,"num_write":277225,"num_write_kb":1108804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'321793","reported_seq":632666,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:40:04.925267+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:40:04.925267+0000","last_peered":"2023-09-23T08:40:04.925267+0000","last_clean":"2023-09-23T08:40:04.925267+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:40:04.925267+0000","last_undegraded":"2023-09-23T08:40:04.925267+0000","last_fullsized":"2023-09-23T08:40:04.925267+0000","mapping_epoch":13,"log_start":"88'311707","ondisk_log_start":"88'311707","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":318,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 153s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3090575679,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":310834,"num_read_kb":1219134,"num_write":307467,"num_write_kb":1229637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'304204","reported_seq":596909,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:40:04.934592+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:40:04.934592+0000","last_peered":"2023-09-23T08:40:04.934592+0000","last_clean":"2023-09-23T08:40:04.934592+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:40:04.934592+0000","last_undegraded":"2023-09-23T08:40:04.934592+0000","last_fullsized":"2023-09-23T08:40:04.934592+0000","mapping_epoch":13,"log_start":"88'294110","ondisk_log_start":"88'294110","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":226,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 102s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2877198636,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":291877,"num_read_kb":1148589,"num_write":289916,"num_write_kb":1159577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'309938","reported_seq":619654,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:40:04.920606+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:40:04.920606+0000","last_peered":"2023-09-23T08:40:04.920606+0000","last_clean":"2023-09-23T08:40:04.920606+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:40:04.920606+0000","last_undegraded":"2023-09-23T08:40:04.920606+0000","last_fullsized":"2023-09-23T08:40:04.920606+0000","mapping_epoch":13,"log_start":"88'299910","ondisk_log_start":"88'299910","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":945,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 489s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3079332122,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":310169,"num_read_kb":1226567,"num_write":308552,"num_write_kb":1234121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'302326","reported_seq":603260,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:06.280533+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:40:06.280533+0000","last_peered":"2023-09-23T08:40:06.280533+0000","last_clean":"2023-09-23T08:40:06.280533+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:40:06.280533+0000","last_undegraded":"2023-09-23T08:40:06.280533+0000","last_fullsized":"2023-09-23T08:40:06.280533+0000","mapping_epoch":13,"log_start":"88'292309","ondisk_log_start":"88'292309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2971795774,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":300509,"num_read_kb":1182819,"num_write":298760,"num_write_kb":1194890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'312594","reported_seq":621560,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:06.972661+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:40:06.972661+0000","last_peered":"2023-09-23T08:40:06.972661+0000","last_clean":"2023-09-23T08:40:06.972661+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:40:06.972661+0000","last_undegraded":"2023-09-23T08:40:06.972661+0000","last_fullsized":"2023-09-23T08:40:06.972661+0000","mapping_epoch":13,"log_start":"88'302511","ondisk_log_start":"88'302511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3060814294,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":308024,"num_read_kb":1211504,"num_write":305509,"num_write_kb":1221916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'285978","reported_seq":568753,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:06.983576+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:40:06.983576+0000","last_peered":"2023-09-23T08:40:06.983576+0000","last_clean":"2023-09-23T08:40:06.983576+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:40:06.983576+0000","last_undegraded":"2023-09-23T08:40:06.983576+0000","last_fullsized":"2023-09-23T08:40:06.983576+0000","mapping_epoch":13,"log_start":"88'275908","ondisk_log_start":"88'275908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2775884077,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":281765,"num_read_kb":1108241,"num_write":278947,"num_write_kb":1115701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'302090","reported_seq":594020,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:04.888733+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:40:04.888733+0000","last_peered":"2023-09-23T08:40:04.888733+0000","last_clean":"2023-09-23T08:40:04.888733+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:40:04.888733+0000","last_undegraded":"2023-09-23T08:40:04.888733+0000","last_fullsized":"2023-09-23T08:40:04.888733+0000","mapping_epoch":13,"log_start":"88'292006","ondisk_log_start":"88'292006","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2847588886,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":291047,"num_read_kb":1144435,"num_write":287123,"num_write_kb":1148375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":265,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:33.126743+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:36:33.126743+0000","last_peered":"2023-09-23T08:36:33.126743+0000","last_clean":"2023-09-23T08:36:33.126743+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:36:33.126743+0000","last_undegraded":"2023-09-23T08:36:33.126743+0000","last_fullsized":"2023-09-23T08:36:33.126743+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23469243179,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2375205,"num_read_kb":9347023,"num_write":2353499,"num_write_kb":9413021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18237726720,"data_stored":22283626070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80495,"ondisk_log_size":80495,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739370,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4864176,"kb_used_data":3299108,"kb_used_omap":319,"kb_used_meta":1564736,"kb_avail":89507664,"statfs":{"total":96636764160,"available":91655847936,"internally_reserved":0,"allocated":3378286592,"data_stored":4119079326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1602289900},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1,1,5,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:39:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":0.84999999999999998,"15min":0.80100000000000005},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.17199999999999999},"max":{"1min":7.7039999999999997,"5min":7.7039999999999997,"15min":10.922000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":7.6520000000000001,"5min":7.9939999999999998,"15min":10.954000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:39:32 2023","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":0.97199999999999998,"15min":1.032},"min":{"1min":0.248,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":10.759,"5min":10.759,"15min":10.759},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.595,"5min":1.0780000000000001,"15min":1.3220000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":12.379,"5min":12.379,"15min":14.311999999999999},"last":0.89000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739356,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11012700,"kb_used_data":8904656,"kb_used_omap":796,"kb_used_meta":2107235,"kb_avail":83359140,"statfs":{"total":96636764160,"available":85359759360,"internally_reserved":0,"allocated":9118367744,"data_stored":11141579216,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":816126,"internal_metadata":2157808642},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,3,8,8,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.76400000000000001,"15min":0.90200000000000002},"min":{"1min":0.22900000000000001,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":2.4670000000000001,"5min":9.9459999999999997,"15min":21.216000000000001},"last":0.252},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.397},"min":{"1min":0.189,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":4.4489999999999998,"5min":10.022,"15min":21.388999999999999},"last":5.6749999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.67500000000000004,"15min":0.92700000000000005},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.329,"5min":7.9909999999999997,"15min":26.117000000000001},"last":1.9339999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73699999999999999,"15min":0.90600000000000003},"min":{"1min":0.254,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":3.665,"5min":7.8170000000000002,"15min":26.151},"last":0.28499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739365,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7869224,"kb_used_data":5607832,"kb_used_omap":467,"kb_used_meta":2260908,"kb_avail":86502616,"statfs":{"total":96636764160,"available":88578678784,"internally_reserved":0,"allocated":5742419968,"data_stored":7024200887,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":2315170753},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,0,2,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:39:27 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.163,"15min":1.0880000000000001},"min":{"1min":0.248,"5min":0.186,"15min":0.17299999999999999},"max":{"1min":3.972,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.093,"5min":1.21,"15min":1.1870000000000001},"min":{"1min":0.29399999999999998,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":4.0060000000000002,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Sat Sep 23 08:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.76000000000000001},"min":{"1min":0.221,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":4.0570000000000004,"5min":5.9390000000000001,"15min":12.529},"last":0.44},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.48499999999999999,"15min":0.65100000000000002},"min":{"1min":0.24099999999999999,"5min":0.22800000000000001,"15min":0.184},"max":{"1min":0.52600000000000002,"5min":6.1779999999999999,"15min":12.388},"last":0.29899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5742051328,"data_stored":7023687186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9118117888,"data_stored":11141155627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3377557504,"data_stored":4118783257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:40:08.861 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:40:08.862 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:40:08.862 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:40:08.862 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:40:14.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:14.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:14.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:14.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:14.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:14.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:14.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:14.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:14.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:14.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:15.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:15.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:15.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:15.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:15.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:15.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:15.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:15.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:15.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:15.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:18.913 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:18.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:18.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:18.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:18.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:18.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:18.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:18.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:18.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:18.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:18.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:18.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:18.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:18.977+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:21.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:21.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:21.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:21.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:21.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:21.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:21.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:21.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:21.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:40:21.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:21.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:21.299 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:21.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:21.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:21.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:21.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:21.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:21.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:21.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:21.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:21.425+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:23.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:23.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:23.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:23.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:23.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:23.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:23.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:23.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:23.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:23.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:23.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:23.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:23.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:23.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:23.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:23.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:23.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:23.514 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:23.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:23.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:23.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:23.755 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:23.748+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:40:23.755 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:23.748+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:40:25.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:25.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:25.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:25.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:25.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:25.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:25.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:25.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:25.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:25.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:25.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:25.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:25.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:25.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:25.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:25.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:25.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:25.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:25.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:25.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:26.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:26.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:26.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:26.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:26.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:26.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:26.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:26.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:26.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:26.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:26.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:26.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:26.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:26.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:26.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:27.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:27.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:27.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:27.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:28.863 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:40:29.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:29.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:29.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:29.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:29.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:29.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:29.562 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:29.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:29.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:29.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:29.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:29.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:29.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:29.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:29.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:29.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:40:29.766 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:40:29.835 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2599,"stamp":"2023-09-23T08:40:28.559584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23485812043,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2383023,"num_read_kb":9377910,"num_write":2361262,"num_write_kb":9445419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80306,"ondisk_log_size":80306,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24033016,"kb_used_data":17847636,"kb_used_omap":1583,"kb_used_meta":6183760,"kb_avail":259082504,"statfs":{"total":289910292480,"available":265300484096,"internally_reserved":0,"allocated":18275979264,"data_stored":22317127717,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1621841,"internal_metadata":6332170415},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,8,4,13,13,10,19,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8892416,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4377,"num_read_kb":17488,"num_write":4252,"num_write_kb":17008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002001"},"pg_stats":[{"pgid":"2.7","version":"88'293115","reported_seq":575985,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:25.670235+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:40:25.670235+0000","last_peered":"2023-09-23T08:40:25.670235+0000","last_clean":"2023-09-23T08:40:25.670235+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:40:25.670235+0000","last_undegraded":"2023-09-23T08:40:25.670235+0000","last_fullsized":"2023-09-23T08:40:25.670235+0000","mapping_epoch":13,"log_start":"88'283111","ondisk_log_start":"88'283111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2767929679,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":281893,"num_read_kb":1109386,"num_write":278159,"num_write_kb":1112540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'322835","reported_seq":634690,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:40:25.648582+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:40:25.648582+0000","last_peered":"2023-09-23T08:40:25.648582+0000","last_clean":"2023-09-23T08:40:25.648582+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:40:25.648582+0000","last_undegraded":"2023-09-23T08:40:25.648582+0000","last_fullsized":"2023-09-23T08:40:25.648582+0000","mapping_epoch":13,"log_start":"88'312807","ondisk_log_start":"88'312807","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":368,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 174s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3092660543,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":311797,"num_read_kb":1222978,"num_write":308440,"num_write_kb":1233529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'305247","reported_seq":598893,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:40:25.617176+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:40:25.617176+0000","last_peered":"2023-09-23T08:40:25.617176+0000","last_clean":"2023-09-23T08:40:25.617176+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:40:25.617176+0000","last_undegraded":"2023-09-23T08:40:25.617176+0000","last_fullsized":"2023-09-23T08:40:25.617176+0000","mapping_epoch":13,"log_start":"88'295210","ondisk_log_start":"88'295210","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":274,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 122s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2879201580,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":292800,"num_read_kb":1152277,"num_write":290893,"num_write_kb":1163485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'311027","reported_seq":621793,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:40:25.602905+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:40:25.602905+0000","last_peered":"2023-09-23T08:40:25.602905+0000","last_clean":"2023-09-23T08:40:25.602905+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:40:25.602905+0000","last_undegraded":"2023-09-23T08:40:25.602905+0000","last_fullsized":"2023-09-23T08:40:25.602905+0000","mapping_epoch":13,"log_start":"88'301010","ondisk_log_start":"88'301010","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":990,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 509s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3081572634,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":311208,"num_read_kb":1230703,"num_write":309611,"num_write_kb":1238357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'303243","reported_seq":605171,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:26.423477+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:40:26.423477+0000","last_peered":"2023-09-23T08:40:26.423477+0000","last_clean":"2023-09-23T08:40:26.423477+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:40:26.423477+0000","last_undegraded":"2023-09-23T08:40:26.423477+0000","last_fullsized":"2023-09-23T08:40:26.423477+0000","mapping_epoch":13,"log_start":"88'293209","ondisk_log_start":"88'293209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2973729086,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":301495,"num_read_kb":1186755,"num_write":299671,"num_write_kb":1198534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'313547","reported_seq":623527,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:27.029191+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:40:27.029191+0000","last_peered":"2023-09-23T08:40:27.029191+0000","last_clean":"2023-09-23T08:40:27.029191+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:40:27.029191+0000","last_undegraded":"2023-09-23T08:40:27.029191+0000","last_fullsized":"2023-09-23T08:40:27.029191+0000","mapping_epoch":13,"log_start":"88'303511","ondisk_log_start":"88'303511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3062817238,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":309022,"num_read_kb":1215492,"num_write":306441,"num_write_kb":1225644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'286853","reported_seq":570575,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:27.047326+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:40:27.047326+0000","last_peered":"2023-09-23T08:40:27.047326+0000","last_clean":"2023-09-23T08:40:27.047326+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:40:27.047326+0000","last_undegraded":"2023-09-23T08:40:27.047326+0000","last_fullsized":"2023-09-23T08:40:27.047326+0000","mapping_epoch":13,"log_start":"88'276808","ondisk_log_start":"88'276808","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2777751853,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":282700,"num_read_kb":1111981,"num_write":279801,"num_write_kb":1119117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'303112","reported_seq":596008,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:25.620492+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:40:25.620492+0000","last_peered":"2023-09-23T08:40:25.620492+0000","last_clean":"2023-09-23T08:40:25.620492+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:40:25.620492+0000","last_undegraded":"2023-09-23T08:40:25.620492+0000","last_fullsized":"2023-09-23T08:40:25.620492+0000","mapping_epoch":13,"log_start":"88'293106","ondisk_log_start":"88'293106","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2849559062,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":292002,"num_read_kb":1148247,"num_write":288109,"num_write_kb":1152319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":265,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:36:33.126743+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:36:33.126743+0000","last_peered":"2023-09-23T08:36:33.126743+0000","last_clean":"2023-09-23T08:36:33.126743+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:36:33.126743+0000","last_undegraded":"2023-09-23T08:36:33.126743+0000","last_fullsized":"2023-09-23T08:36:33.126743+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23485221675,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2382917,"num_read_kb":9377819,"num_write":2361125,"num_write_kb":9443525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18274439168,"data_stored":22315730518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80207,"ondisk_log_size":80207,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739374,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4932944,"kb_used_data":3305412,"kb_used_omap":319,"kb_used_meta":1627200,"kb_avail":89438896,"statfs":{"total":96636764160,"available":91585429504,"internally_reserved":0,"allocated":3384741888,"data_stored":4124776862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1666253036},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,4,2,1,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:39:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":0.84999999999999998,"15min":0.80100000000000005},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.17199999999999999},"max":{"1min":7.7039999999999997,"5min":7.7039999999999997,"15min":10.922000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":7.6520000000000001,"5min":7.9939999999999998,"15min":10.954000000000001},"last":0.31900000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:39:32 2023","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":0.97199999999999998,"15min":1.032},"min":{"1min":0.248,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":10.759,"5min":10.759,"15min":10.759},"last":0.41899999999999998},{"interface":"front","average":{"1min":1.595,"5min":1.0780000000000001,"15min":1.3220000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":12.379,"5min":12.379,"15min":14.311999999999999},"last":0.434}]}]},{"osd":1,"up_from":8,"seq":34359739360,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11155524,"kb_used_data":8923256,"kb_used_omap":796,"kb_used_meta":2231459,"kb_avail":83216316,"statfs":{"total":96636764160,"available":85213507584,"internally_reserved":0,"allocated":9137414144,"data_stored":11158233552,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":816126,"internal_metadata":2285014018},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,4,5,9,9,14,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.80600000000000005,"15min":0.88500000000000001},"min":{"1min":0.221,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":6.8689999999999998,"5min":9.9459999999999997,"15min":21.216000000000001},"last":1.274},{"interface":"front","average":{"1min":1.7310000000000001,"5min":1.3919999999999999,"15min":1.345},"min":{"1min":0.23799999999999999,"5min":0.17899999999999999,"15min":0.17599999999999999},"max":{"1min":6.7300000000000004,"5min":10.022,"15min":21.388999999999999},"last":1.464}]},{"osd":2,"last update":"Sat Sep 23 08:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.91800000000000004},"min":{"1min":0.25600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.4769999999999999,"5min":7.9909999999999997,"15min":26.117000000000001},"last":0.309},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.71599999999999997,"15min":0.93000000000000005},"min":{"1min":0.27800000000000002,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":5.1479999999999997,"5min":5.2640000000000002,"15min":26.151},"last":0.26300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739369,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7944548,"kb_used_data":5618968,"kb_used_omap":467,"kb_used_meta":2325100,"kb_avail":86427292,"statfs":{"total":96636764160,"available":88501547008,"internally_reserved":0,"allocated":5753823232,"data_stored":7034117303,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":2380903361},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,0,4,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:39:27 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.163,"15min":1.0880000000000001},"min":{"1min":0.248,"5min":0.186,"15min":0.17299999999999999},"max":{"1min":3.972,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.21,"15min":1.1870000000000001},"min":{"1min":0.29399999999999998,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":4.0060000000000002,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.626}]},{"osd":2,"last update":"Sat Sep 23 08:40:08 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":0.72799999999999998,"15min":0.82599999999999996},"min":{"1min":0.25,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":8.7699999999999996,"5min":8.7699999999999996,"15min":12.529},"last":4.4089999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.65100000000000002},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":2.859,"5min":6.1779999999999999,"15min":12.388},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5753307136,"data_stored":7033456146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9136771072,"data_stored":11157482283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3384360960,"data_stored":4124792089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:40:29.836 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:40:29.837 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:40:29.837 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:40:29.837 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:40:30.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:30.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:30.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:30.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:30.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:30.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:30.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:30.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:40:30.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:30.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:30.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:30.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:30.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:30.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:30.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:30.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:30.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:30.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:30.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:30.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:30.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:31.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:31.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:31.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:31.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:31.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:31.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:31.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:31.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:31.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:31.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:31.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:31.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:31.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:31.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:31.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:31.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:31.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:31.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:33.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:33.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:33.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:33.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:33.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:33.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:33.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:33.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:33.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:33.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:33.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:33.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:33.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:33.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:33.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:33.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:33.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:33.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:33.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:33.532+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:35.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:35.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:35.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:35.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:35.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:35.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:35.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:35.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:35.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:35.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:35.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:35.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:36.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:36.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:36.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:36.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:36.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:36.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:36.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:36.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:36.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:40:36.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:36.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:36.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:36.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:36.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:36.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:36.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:36.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:36.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:36.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:36.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:36.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:37.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:37.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:37.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:37.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:37.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:37.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:37.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:37.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:37.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:37.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:37.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:37.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:37.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:37.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:37.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:37.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:37.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.924+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:37.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:38.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:37.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:38.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:38.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:38.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:38.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:38.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:38.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:38.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:38.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:39.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:39.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:39.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:39.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:39.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:39.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:39.785 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:39.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:39.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:39.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:39.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:39.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:40.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:40.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:40:40.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:40.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:40.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:40.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:40.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:40.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:40.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:40.340+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:40.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:40.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:40.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:40.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:40.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:40.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:40.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:40.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:40.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:40.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:41.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:41.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:41.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:41.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:41.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:41.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:41.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:41.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:41.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:41.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:41.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:41.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:41.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:41.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:41.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:41.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:41.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:41.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:42.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:42.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:42.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:42.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:42.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:42.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:42.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:42.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:42.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:42.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:42.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:42.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:42.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:42.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:42.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:42.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:44.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:44.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:44.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:44.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:44.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:44.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:44.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:44.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:45.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:45.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:45.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:45.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:45.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:45.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:45.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:45.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:45.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:45.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:45.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:45.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:46.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:46.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:46.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:46.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:46.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:46.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:46.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:46.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:46.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:46.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:46.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:46.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:47.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:47.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:48.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:48.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:48.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:48.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:48.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:48.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:48.238 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:48.232+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:40:48.239 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:48.232+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:40:48.245 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:48.240+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:40:48.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:48.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:48.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:48.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:48.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:48.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:48.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:48.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:48.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:48.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:48.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:48.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:49.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:49.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:49.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:49.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:49.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:49.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:49.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:49.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:49.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:49.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:49.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:49.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:49.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:49.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:49.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:49.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:49.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:49.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:49.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:40:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:40:50.833 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:40:50.938 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2610,"stamp":"2023-09-23T08:40:50.569743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23501290827,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2390297,"num_read_kb":9406970,"num_write":2368718,"num_write_kb":9475243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80331,"ondisk_log_size":80331,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24134968,"kb_used_data":17882200,"kb_used_omap":1583,"kb_used_meta":6251152,"kb_avail":258980552,"statfs":{"total":289910292480,"available":265196085248,"internally_reserved":0,"allocated":18311372800,"data_stored":22348224549,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1621841,"internal_metadata":6401179823},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,0,3,13,11,15,10,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7589888,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3598,"num_read_kb":14376,"num_write":3700,"num_write_kb":14800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004741"},"pg_stats":[{"pgid":"2.7","version":"88'294112","reported_seq":577844,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:46.303042+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:40:46.303042+0000","last_peered":"2023-09-23T08:40:46.303042+0000","last_clean":"2023-09-23T08:40:46.303042+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:40:46.303042+0000","last_undegraded":"2023-09-23T08:40:46.303042+0000","last_fullsized":"2023-09-23T08:40:46.303042+0000","mapping_epoch":13,"log_start":"88'284111","ondisk_log_start":"88'284111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2769772879,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":282742,"num_read_kb":1112766,"num_write":279094,"num_write_kb":1116280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'323874","reported_seq":636754,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:40:46.284239+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:40:46.284239+0000","last_peered":"2023-09-23T08:40:46.284239+0000","last_clean":"2023-09-23T08:40:46.284239+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:40:46.284239+0000","last_undegraded":"2023-09-23T08:40:46.284239+0000","last_fullsized":"2023-09-23T08:40:46.284239+0000","mapping_epoch":13,"log_start":"88'313807","ondisk_log_start":"88'313807","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":407,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 195s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3094581567,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":312806,"num_read_kb":1227010,"num_write":309401,"num_write_kb":1237373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'306235","reported_seq":600823,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:40:46.313777+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:40:46.313777+0000","last_peered":"2023-09-23T08:40:46.313777+0000","last_clean":"2023-09-23T08:40:46.313777+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:40:46.313777+0000","last_undegraded":"2023-09-23T08:40:46.313777+0000","last_fullsized":"2023-09-23T08:40:46.313777+0000","mapping_epoch":13,"log_start":"88'296210","ondisk_log_start":"88'296210","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":333,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 143s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2881044780,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":293720,"num_read_kb":1155953,"num_write":291783,"num_write_kb":1167045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'312015","reported_seq":623749,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:40:46.300387+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:40:46.300387+0000","last_peered":"2023-09-23T08:40:46.300387+0000","last_clean":"2023-09-23T08:40:46.300387+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:40:46.300387+0000","last_undegraded":"2023-09-23T08:40:46.300387+0000","last_fullsized":"2023-09-23T08:40:46.300387+0000","mapping_epoch":13,"log_start":"88'302010","ondisk_log_start":"88'302010","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1042,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 530s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3083645210,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":312170,"num_read_kb":1234551,"num_write":310565,"num_write_kb":1242173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'304229","reported_seq":607056,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:46.593016+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:40:46.593016+0000","last_peered":"2023-09-23T08:40:46.593016+0000","last_clean":"2023-09-23T08:40:46.593016+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:40:46.593016+0000","last_undegraded":"2023-09-23T08:40:46.593016+0000","last_fullsized":"2023-09-23T08:40:46.593016+0000","mapping_epoch":13,"log_start":"88'294209","ondisk_log_start":"88'294209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2975809854,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":302387,"num_read_kb":1190323,"num_write":300653,"num_write_kb":1202462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'314495","reported_seq":625422,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:47.170108+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:40:47.170108+0000","last_peered":"2023-09-23T08:40:47.170108+0000","last_clean":"2023-09-23T08:40:47.170108+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:40:47.170108+0000","last_undegraded":"2023-09-23T08:40:47.170108+0000","last_fullsized":"2023-09-23T08:40:47.170108+0000","mapping_epoch":13,"log_start":"88'304411","ondisk_log_start":"88'304411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3064775126,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":309958,"num_read_kb":1219236,"num_write":307374,"num_write_kb":1229376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'287736","reported_seq":572309,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:47.177359+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:40:47.177359+0000","last_peered":"2023-09-23T08:40:47.177359+0000","last_clean":"2023-09-23T08:40:47.177359+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:40:47.177359+0000","last_undegraded":"2023-09-23T08:40:47.177359+0000","last_fullsized":"2023-09-23T08:40:47.177359+0000","mapping_epoch":13,"log_start":"88'277708","ondisk_log_start":"88'277708","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2779578669,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":283541,"num_read_kb":1115341,"num_write":280669,"num_write_kb":1122589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'304108","reported_seq":597881,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:46.257405+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:40:46.257405+0000","last_peered":"2023-09-23T08:40:46.257405+0000","last_clean":"2023-09-23T08:40:46.257405+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:40:46.257405+0000","last_undegraded":"2023-09-23T08:40:46.257405+0000","last_fullsized":"2023-09-23T08:40:46.257405+0000","mapping_epoch":13,"log_start":"88'294106","ondisk_log_start":"88'294106","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2851492374,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":292867,"num_read_kb":1151699,"num_write":289042,"num_write_kb":1156051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":266,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:36.793590+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:38:36.793590+0000","last_peered":"2023-09-23T08:38:36.793590+0000","last_clean":"2023-09-23T08:38:36.793590+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:38:36.793590+0000","last_undegraded":"2023-09-23T08:38:36.793590+0000","last_fullsized":"2023-09-23T08:38:36.793590+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23500700459,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2390191,"num_read_kb":9406879,"num_write":2368581,"num_write_kb":9473349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18310299648,"data_stored":22347232854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80232,"ondisk_log_size":80232,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739378,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4971572,"kb_used_data":3312108,"kb_used_omap":319,"kb_used_meta":1659136,"kb_avail":89400268,"statfs":{"total":96636764160,"available":91545874432,"internally_reserved":0,"allocated":3391598592,"data_stored":4130826654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1698955500},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.17199999999999999},"max":{"1min":2.8140000000000001,"5min":7.7039999999999997,"15min":10.922000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":0.90200000000000002,"15min":0.75600000000000001},"min":{"1min":0.219,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":14.997999999999999,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:40:32 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.042,"15min":1.0409999999999999},"min":{"1min":0.25900000000000001,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":4.726,"5min":10.759,"15min":10.759},"last":0.372},{"interface":"front","average":{"1min":2.0840000000000001,"5min":1.3380000000000001,"15min":1.246},"min":{"1min":0.23300000000000001,"5min":0.184,"15min":0.184},"max":{"1min":8.0640000000000001,"5min":12.379,"15min":14.311999999999999},"last":0.39500000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739364,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11217248,"kb_used_data":8940440,"kb_used_omap":796,"kb_used_meta":2276003,"kb_avail":83154592,"statfs":{"total":96636764160,"available":85150302208,"internally_reserved":0,"allocated":9155010560,"data_stored":11173687760,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":816126,"internal_metadata":2330627074},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,0,12,8,8,7,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.80600000000000005,"15min":0.88500000000000001},"min":{"1min":0.221,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":6.8689999999999998,"5min":9.9459999999999997,"15min":21.216000000000001},"last":0.215},{"interface":"front","average":{"1min":1.7310000000000001,"5min":1.3919999999999999,"15min":1.345},"min":{"1min":0.23799999999999999,"5min":0.17899999999999999,"15min":0.17599999999999999},"max":{"1min":6.7300000000000004,"5min":10.022,"15min":21.388999999999999},"last":0.23999999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.91800000000000004},"min":{"1min":0.25600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.4769999999999999,"5min":7.9909999999999997,"15min":26.117000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.71599999999999997,"15min":0.93000000000000005},"min":{"1min":0.27800000000000002,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":5.1479999999999997,"5min":5.2640000000000002,"15min":26.151},"last":0.307}]}]},{"osd":0,"up_from":8,"seq":34359739373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7946148,"kb_used_data":5629652,"kb_used_omap":467,"kb_used_meta":2316012,"kb_avail":86425692,"statfs":{"total":96636764160,"available":88499908608,"internally_reserved":0,"allocated":5764763648,"data_stored":7043710135,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":478271,"internal_metadata":2371597249},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,3,7,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:40:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.1180000000000001,"15min":1.1000000000000001},"min":{"1min":0.216,"5min":0.19400000000000001,"15min":0.17299999999999999},"max":{"1min":5.5679999999999996,"5min":17.216000000000001,"15min":17.216000000000001},"last":2.5299999999999998},{"interface":"front","average":{"1min":1.819,"5min":1.252,"15min":1.2270000000000001},"min":{"1min":0.30499999999999999,"5min":0.27400000000000002,"15min":0.222},"max":{"1min":14.000999999999999,"5min":17.251000000000001,"15min":17.251000000000001},"last":2.5630000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:40:08 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":0.72799999999999998,"15min":0.82599999999999996},"min":{"1min":0.25,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":8.7699999999999996,"5min":8.7699999999999996,"15min":12.529},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.504,"15min":0.65100000000000002},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":2.859,"5min":6.1779999999999999,"15min":12.388},"last":0.29899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5764509696,"data_stored":7043282450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9154908160,"data_stored":11173407531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3390881792,"data_stored":4130542873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:40:50.940 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:40:50.940 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:40:50.941 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:40:50.941 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-09-23T08:40:51.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:40:51.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:51.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:51.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:51.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:51.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:51.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:51.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:51.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:51.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:51.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:51.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:51.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:51.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:51.858 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-09-23T08:40:51.942 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-09-23T08:40:52.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:52.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:40:52.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:52.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:52.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:52.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:52.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:52.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:52.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:52.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:52.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:52.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:52.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:52.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:52.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:52.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:52.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:52.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:52.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:52.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:52.779 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-09-23T08:40:52.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-09-23T08:40:53.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:40:53.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:53.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:53.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:53.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:53.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:53.708 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-09-23T08:40:53.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:53.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:53.761 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:40:53.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:53.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:53.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:53.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:55.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:55.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:55.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:55.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:55.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:55.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:55.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:55.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:55.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:55.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:55.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:55.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:56.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:56.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:56.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:56.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:40:56.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:56.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:56.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:56.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:56.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:56.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:56.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:56.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:56.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:56.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:56.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:56.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:56.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:56.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:57.766 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:57.760+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:40:57.766 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:57.760+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:40:57.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:57.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:57.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:57.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:57.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:57.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:57.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:57.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:57.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:57.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:58.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:58.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:58.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:58.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:40:59.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:59.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:40:59.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:59.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:40:59.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:59.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:40:59.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:59.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:40:59.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:59.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:40:59.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:59.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:40:59.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:59.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:40:59.511 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:40:59.500+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:40:59.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:59.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:40:59.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:40:59.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:00.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:41:00.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:00.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:00.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:00.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:00.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:00.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:00.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:00.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:00.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:00.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:00.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:00.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:02.697 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:02.692+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:41:02.698 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:02.692+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:41:02.698 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:02.692+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:41:02.841 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:02.836+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:41:02.842 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:02.836+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:41:02.842 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:02.836+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:41:05.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:05.432+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:05.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:05.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:05.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:05.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:05.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:05.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:05.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:05.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:05.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:05.536+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:05.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:05.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:05.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:05.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:05.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:05.992+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:06.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:06.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:06.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:06.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:06.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:06.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:06.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:06.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:06.723 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:06.716+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:41:06.723 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:06.716+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:41:06.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:06.950 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:06.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:06.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:06.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:08.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:08.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:08.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:08.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:08.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:08.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:08.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:08.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:08.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:08.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:08.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:08.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:08.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:08.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:08.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:08.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:08.979 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:08.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:13.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:13.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:13.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:13.111 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:13.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:13.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:13.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:13.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:13.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:13.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:13.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:13.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:13.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:13.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.380+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:13.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:13.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:13.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:13.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:13.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:13.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:13.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:13.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:13.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:13.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:41:13.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:41:13.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:13.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:13.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:13.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:13.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:13.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:13.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:13.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:13.762 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:41:13.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:13.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:13.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:13.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:13.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:13.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:13.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:41:14.430 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:41:14.470 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2621,"stamp":"2023-09-23T08:41:12.579973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23520324939,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2399157,"num_read_kb":9442330,"num_write":2378028,"num_write_kb":9512483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80447,"ondisk_log_size":80447,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22637240,"kb_used_data":17925960,"kb_used_omap":1644,"kb_used_meta":4709587,"kb_avail":260478280,"statfs":{"total":289910292480,"available":266729758720,"internally_reserved":0,"allocated":18356183040,"data_stored":22386808869,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1684073,"internal_metadata":4822617495},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,5,10,10,22,15,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11702272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":21328,"num_write":5703,"num_write_kb":22812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008590"},"pg_stats":[{"pgid":"2.7","version":"88'295254","reported_seq":580040,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:12.201591+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:41:12.201591+0000","last_peered":"2023-09-23T08:41:12.201591+0000","last_clean":"2023-09-23T08:41:12.201591+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:41:12.201591+0000","last_undegraded":"2023-09-23T08:41:12.201591+0000","last_fullsized":"2023-09-23T08:41:12.201591+0000","mapping_epoch":13,"log_start":"88'285211","ondisk_log_start":"88'285211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2771976527,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":283781,"num_read_kb":1116914,"num_write":280176,"num_write_kb":1120608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'325151","reported_seq":639244,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:41:12.175932+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:41:12.175932+0000","last_peered":"2023-09-23T08:41:12.175932+0000","last_clean":"2023-09-23T08:41:12.175932+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:41:12.175932+0000","last_undegraded":"2023-09-23T08:41:12.175932+0000","last_fullsized":"2023-09-23T08:41:12.175932+0000","mapping_epoch":13,"log_start":"88'315107","ondisk_log_start":"88'315107","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":460,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 220s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3097211199,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":313992,"num_read_kb":1231750,"num_write":310589,"num_write_kb":1242125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'307532","reported_seq":603234,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:41:12.126429+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:41:12.126429+0000","last_peered":"2023-09-23T08:41:12.126429+0000","last_clean":"2023-09-23T08:41:12.126429+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:41:12.126429+0000","last_undegraded":"2023-09-23T08:41:12.126429+0000","last_fullsized":"2023-09-23T08:41:12.126429+0000","mapping_epoch":13,"log_start":"88'297510","ondisk_log_start":"88'297510","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":402,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 169s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2883481900,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":294809,"num_read_kb":1160297,"num_write":292981,"num_write_kb":1171837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'313288","reported_seq":626205,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:41:12.137517+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:41:12.137517+0000","last_peered":"2023-09-23T08:41:12.137517+0000","last_clean":"2023-09-23T08:41:12.137517+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:41:12.137517+0000","last_undegraded":"2023-09-23T08:41:12.137517+0000","last_fullsized":"2023-09-23T08:41:12.137517+0000","mapping_epoch":13,"log_start":"88'303211","ondisk_log_start":"88'303211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1101,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 556s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3086074138,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":313340,"num_read_kb":1239231,"num_write":311802,"num_write_kb":1247121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'305458","reported_seq":609379,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:12.189935+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:41:12.189935+0000","last_peered":"2023-09-23T08:41:12.189935+0000","last_clean":"2023-09-23T08:41:12.189935+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:41:12.189935+0000","last_undegraded":"2023-09-23T08:41:12.189935+0000","last_fullsized":"2023-09-23T08:41:12.189935+0000","mapping_epoch":13,"log_start":"88'295409","ondisk_log_start":"88'295409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2978296126,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":303468,"num_read_kb":1194639,"num_write":301872,"num_write_kb":1207338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'315717","reported_seq":627801,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:12.378593+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:41:12.378593+0000","last_peered":"2023-09-23T08:41:12.378593+0000","last_clean":"2023-09-23T08:41:12.378593+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:41:12.378593+0000","last_undegraded":"2023-09-23T08:41:12.378593+0000","last_fullsized":"2023-09-23T08:41:12.378593+0000","mapping_epoch":13,"log_start":"88'305711","ondisk_log_start":"88'305711","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3067367894,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":311100,"num_read_kb":1223784,"num_write":308569,"num_write_kb":1234156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'288828","reported_seq":574485,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:12.331968+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:41:12.331968+0000","last_peered":"2023-09-23T08:41:12.331968+0000","last_clean":"2023-09-23T08:41:12.331968+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:41:12.331968+0000","last_undegraded":"2023-09-23T08:41:12.331968+0000","last_fullsized":"2023-09-23T08:41:12.331968+0000","mapping_epoch":13,"log_start":"88'278808","ondisk_log_start":"88'278808","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2781708589,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":284607,"num_read_kb":1119589,"num_write":281734,"num_write_kb":1126849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'305293","reported_seq":600169,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:12.100816+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:41:12.100816+0000","last_peered":"2023-09-23T08:41:12.100816+0000","last_clean":"2023-09-23T08:41:12.100816+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:41:12.100816+0000","last_undegraded":"2023-09-23T08:41:12.100816+0000","last_fullsized":"2023-09-23T08:41:12.100816+0000","mapping_epoch":13,"log_start":"88'295206","ondisk_log_start":"88'295206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2853618198,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":293954,"num_read_kb":1156035,"num_write":290168,"num_write_kb":1160555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":266,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:36.793590+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:38:36.793590+0000","last_peered":"2023-09-23T08:38:36.793590+0000","last_clean":"2023-09-23T08:38:36.793590+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:38:36.793590+0000","last_undegraded":"2023-09-23T08:38:36.793590+0000","last_fullsized":"2023-09-23T08:38:36.793590+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23519734571,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2399051,"num_read_kb":9442239,"num_write":2377891,"num_write_kb":9510589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18354290688,"data_stored":22385100374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80348,"ondisk_log_size":80348,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739383,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968072,"kb_used_data":3319744,"kb_used_omap":319,"kb_used_meta":1648000,"kb_avail":89403768,"statfs":{"total":96636764160,"available":91549458432,"internally_reserved":0,"allocated":3399417856,"data_stored":4137564574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1687552236},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,2,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.17199999999999999},"max":{"1min":2.8140000000000001,"5min":7.7039999999999997,"15min":10.922000000000001},"last":0.316},{"interface":"front","average":{"1min":1.4079999999999999,"5min":0.90200000000000002,"15min":0.75600000000000001},"min":{"1min":0.219,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":14.997999999999999,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.33900000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:40:32 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.042,"15min":1.0409999999999999},"min":{"1min":0.25900000000000001,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":4.726,"5min":10.759,"15min":10.759},"last":0.27800000000000002},{"interface":"front","average":{"1min":2.0840000000000001,"5min":1.3380000000000001,"15min":1.246},"min":{"1min":0.23300000000000001,"5min":0.184,"15min":0.184},"max":{"1min":8.0640000000000001,"5min":12.379,"15min":14.311999999999999},"last":0.247}]}]},{"osd":1,"up_from":8,"seq":34359739369,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9917244,"kb_used_data":8962720,"kb_used_omap":856,"kb_used_meta":953639,"kb_avail":84454596,"statfs":{"total":96636764160,"available":86481506304,"internally_reserved":0,"allocated":9177825280,"data_stored":11193340368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":976527226},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,8,3,14,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.80600000000000005,"15min":0.88500000000000001},"min":{"1min":0.221,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":6.8689999999999998,"5min":9.9459999999999997,"15min":21.216000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.7310000000000001,"5min":1.3919999999999999,"15min":1.345},"min":{"1min":0.23799999999999999,"5min":0.17899999999999999,"15min":0.17599999999999999},"max":{"1min":6.7300000000000004,"5min":10.022,"15min":21.388999999999999},"last":0.35099999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.91800000000000004},"min":{"1min":0.25600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.4769999999999999,"5min":7.9909999999999997,"15min":26.117000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.71599999999999997,"15min":0.93000000000000005},"min":{"1min":0.27800000000000002,"5min":0.24299999999999999,"15min":0.20100000000000001},"max":{"1min":5.1479999999999997,"5min":5.2640000000000002,"15min":26.151},"last":0.371}]}]},{"osd":0,"up_from":8,"seq":34359739378,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7751924,"kb_used_data":5643496,"kb_used_omap":468,"kb_used_meta":2107947,"kb_avail":86619916,"statfs":{"total":96636764160,"available":88698793984,"internally_reserved":0,"allocated":5778939904,"data_stored":7055903927,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":479951,"internal_metadata":2158538033},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,2,5,6,6,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:40:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.1180000000000001,"15min":1.1000000000000001},"min":{"1min":0.216,"5min":0.19400000000000001,"15min":0.17299999999999999},"max":{"1min":5.5679999999999996,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":1.819,"5min":1.252,"15min":1.2270000000000001},"min":{"1min":0.30499999999999999,"5min":0.27400000000000002,"15min":0.222},"max":{"1min":14.000999999999999,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.34200000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.81899999999999995},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":4.4089999999999998,"5min":8.7699999999999996,"15min":12.529},"last":3.347},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.52400000000000002,"15min":0.64100000000000001},"min":{"1min":0.25800000000000001,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":5.8310000000000004,"5min":5.8310000000000004,"15min":12.388},"last":0.25}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5778386944,"data_stored":7055218194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9177112576,"data_stored":11192515371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3398791168,"data_stored":4137366809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:41:14.471 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:41:14.472 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:41:14.472 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:41:14.472 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:41:14.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:14.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:41:14.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:14.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:14.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:14.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:14.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:14.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:14.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:14.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:14.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:14.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:14.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:14.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:14.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:14.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:14.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:14.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:17.412 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:17.408+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:41:17.413 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:17.408+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:41:17.413 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:17.408+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:41:20.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:20.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:20.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:20.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:20.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:20.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:20.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:20.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:41:20.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:41:20.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:20.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:20.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:20.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:20.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:20.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:20.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:20.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:21.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:20.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:21.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:21.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:21.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:21.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:21.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:21.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:21.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:21.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:21.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:21.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:21.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:21.088+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:21.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:21.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:22.004 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:22.000+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:41:25.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:25.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:25.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:25.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:25.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:25.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:25.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:25.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:25.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.792+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:25.813 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:25.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:25.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:25.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:25.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:25.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:25.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:25.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:27.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:27.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:27.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:27.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:27.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:27.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:27.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:27.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:27.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:27.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:27.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:27.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:27.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:27.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:27.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:27.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:27.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:27.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:27.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:27.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:28.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:41:28.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:28.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:28.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:28.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:28.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:28.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:28.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:28.581 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:28.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:28.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:28.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:28.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:28.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:28.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:28.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:28.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:28.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:28.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:28.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:28.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:28.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:28.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:29.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:29.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:29.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:29.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:29.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:29.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:29.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:29.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:29.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:29.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:30.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:30.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:41:30.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:30.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:41:31.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:31.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:31.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:31.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:31.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:31.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:31.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:31.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:31.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:31.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:31.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:31.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:31.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:31.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:33.544 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:33.535+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:41:33.544 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:33.535+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:41:33.544 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:33.535+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:41:34.473 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:41:35.387 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:41:35.388 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:41:35.476 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2632,"stamp":"2023-09-23T08:41:34.585392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23535570251,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2406527,"num_read_kb":9471778,"num_write":2385607,"num_write_kb":9542799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80415,"ondisk_log_size":80415,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22975432,"kb_used_data":17960240,"kb_used_omap":1644,"kb_used_meta":5013523,"kb_avail":260140088,"statfs":{"total":289910292480,"available":266383450112,"internally_reserved":0,"allocated":18391285760,"data_stored":22417397797,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1684073,"internal_metadata":5133847959},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,10,4,6,20,8,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9875456,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4783,"num_read_kb":19108,"num_write":4932,"num_write_kb":19728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003742"},"pg_stats":[{"pgid":"2.7","version":"88'296229","reported_seq":581891,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:32.933817+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:41:32.933817+0000","last_peered":"2023-09-23T08:41:32.933817+0000","last_clean":"2023-09-23T08:41:32.933817+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:41:32.933817+0000","last_undegraded":"2023-09-23T08:41:32.933817+0000","last_fullsized":"2023-09-23T08:41:32.933817+0000","mapping_epoch":13,"log_start":"88'286211","ondisk_log_start":"88'286211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2773958991,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":284646,"num_read_kb":1120374,"num_write":281100,"num_write_kb":1124304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'326233","reported_seq":641368,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:41:32.956723+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:41:32.956723+0000","last_peered":"2023-09-23T08:41:32.956723+0000","last_clean":"2023-09-23T08:41:32.956723+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:41:32.956723+0000","last_undegraded":"2023-09-23T08:41:32.956723+0000","last_fullsized":"2023-09-23T08:41:32.956723+0000","mapping_epoch":13,"log_start":"88'316207","ondisk_log_start":"88'316207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":494,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 241s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3099255103,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":315015,"num_read_kb":1235834,"num_write":311601,"num_write_kb":1246173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'308556","reported_seq":605198,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:41:32.946512+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:41:32.946512+0000","last_peered":"2023-09-23T08:41:32.946512+0000","last_clean":"2023-09-23T08:41:32.946512+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:41:32.946512+0000","last_undegraded":"2023-09-23T08:41:32.946512+0000","last_fullsized":"2023-09-23T08:41:32.946512+0000","mapping_epoch":13,"log_start":"88'298510","ondisk_log_start":"88'298510","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":438,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 190s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2885394732,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":295733,"num_read_kb":1163993,"num_write":293933,"num_write_kb":1175645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'314315","reported_seq":628182,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:41:32.953252+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:41:32.953252+0000","last_peered":"2023-09-23T08:41:32.953252+0000","last_clean":"2023-09-23T08:41:32.953252+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:41:32.953252+0000","last_undegraded":"2023-09-23T08:41:32.953252+0000","last_fullsized":"2023-09-23T08:41:32.953252+0000","mapping_epoch":13,"log_start":"88'304311","ondisk_log_start":"88'304311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1129,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 577s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3088085274,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":314282,"num_read_kb":1242995,"num_write":312814,"num_write_kb":1251169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'306358","reported_seq":611152,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:32.493316+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:41:32.493316+0000","last_peered":"2023-09-23T08:41:32.493316+0000","last_clean":"2023-09-23T08:41:32.493316+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:41:32.493316+0000","last_undegraded":"2023-09-23T08:41:32.493316+0000","last_fullsized":"2023-09-23T08:41:32.493316+0000","mapping_epoch":13,"log_start":"88'296309","ondisk_log_start":"88'296309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2980057406,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":304331,"num_read_kb":1198091,"num_write":302766,"num_write_kb":1210914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'316701","reported_seq":629767,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:32.529957+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:41:32.529957+0000","last_peered":"2023-09-23T08:41:32.529957+0000","last_clean":"2023-09-23T08:41:32.529957+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:41:32.529957+0000","last_undegraded":"2023-09-23T08:41:32.529957+0000","last_fullsized":"2023-09-23T08:41:32.529957+0000","mapping_epoch":13,"log_start":"88'306611","ondisk_log_start":"88'306611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3069305302,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":312069,"num_read_kb":1227648,"num_write":309541,"num_write_kb":1238044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'289759","reported_seq":576330,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:32.503958+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:41:32.503958+0000","last_peered":"2023-09-23T08:41:32.503958+0000","last_clean":"2023-09-23T08:41:32.503958+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:41:32.503958+0000","last_undegraded":"2023-09-23T08:41:32.503958+0000","last_fullsized":"2023-09-23T08:41:32.503958+0000","mapping_epoch":13,"log_start":"88'279708","ondisk_log_start":"88'279708","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2783539501,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":285512,"num_read_kb":1123201,"num_write":282653,"num_write_kb":1130525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'306238","reported_seq":602005,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:32.917319+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:41:32.917319+0000","last_peered":"2023-09-23T08:41:32.917319+0000","last_clean":"2023-09-23T08:41:32.917319+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:41:32.917319+0000","last_undegraded":"2023-09-23T08:41:32.917319+0000","last_fullsized":"2023-09-23T08:41:32.917319+0000","mapping_epoch":13,"log_start":"88'296206","ondisk_log_start":"88'296206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2855383574,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":294833,"num_read_kb":1159551,"num_write":291062,"num_write_kb":1164131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":266,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:36.793590+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:38:36.793590+0000","last_peered":"2023-09-23T08:38:36.793590+0000","last_clean":"2023-09-23T08:38:36.793590+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:38:36.793590+0000","last_undegraded":"2023-09-23T08:38:36.793590+0000","last_fullsized":"2023-09-23T08:38:36.793590+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23534979883,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2406421,"num_read_kb":9471687,"num_write":2385470,"num_write_kb":9540905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18390360064,"data_stored":22416520790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80316,"ondisk_log_size":80316,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739387,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5026156,"kb_used_data":3325988,"kb_used_omap":319,"kb_used_meta":1699840,"kb_avail":89345684,"statfs":{"total":96636764160,"available":91489980416,"internally_reserved":0,"allocated":3405811712,"data_stored":4143163806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1740636396},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3,3,0,10,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.17199999999999999},"max":{"1min":2.8140000000000001,"5min":7.7039999999999997,"15min":10.922000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":1.4079999999999999,"5min":0.90200000000000002,"15min":0.75600000000000001},"min":{"1min":0.219,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":14.997999999999999,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:40:32 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.042,"15min":1.0409999999999999},"min":{"1min":0.25900000000000001,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":4.726,"5min":10.759,"15min":10.759},"last":0.38600000000000001},{"interface":"front","average":{"1min":2.0840000000000001,"5min":1.3380000000000001,"15min":1.246},"min":{"1min":0.23300000000000001,"5min":0.184,"15min":0.184},"max":{"1min":8.0640000000000001,"5min":12.379,"15min":14.311999999999999},"last":2.6110000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739373,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10114372,"kb_used_data":8979964,"kb_used_omap":856,"kb_used_meta":1133543,"kb_avail":84257468,"statfs":{"total":96636764160,"available":86279647232,"internally_reserved":0,"allocated":9195483136,"data_stored":11208716752,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1160748922},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,4,1,4,6,7,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.76300000000000001,"15min":0.871},"min":{"1min":0.215,"5min":0.20799999999999999,"15min":0.191},"max":{"1min":1.274,"5min":9.9459999999999997,"15min":21.216000000000001},"last":0.252},{"interface":"front","average":{"1min":1.026,"5min":1.411,"15min":1.325},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.17599999999999999},"max":{"1min":7.2039999999999997,"5min":10.022,"15min":21.388999999999999},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.67900000000000005,"15min":0.85299999999999998},"min":{"1min":0.219,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":7.3600000000000003,"5min":7.3600000000000003,"15min":10.798999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.101,"5min":0.84799999999999998,"15min":0.873},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":7.4000000000000004,"5min":7.4000000000000004,"15min":11.98},"last":0.29599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739382,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7834904,"kb_used_data":5654288,"kb_used_omap":468,"kb_used_meta":2180139,"kb_avail":86536936,"statfs":{"total":96636764160,"available":88613822464,"internally_reserved":0,"allocated":5789990912,"data_stored":7065517239,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":479951,"internal_metadata":2232462641},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3,0,2,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:40:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.1180000000000001,"15min":1.1000000000000001},"min":{"1min":0.216,"5min":0.19400000000000001,"15min":0.17299999999999999},"max":{"1min":5.5679999999999996,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":1.819,"5min":1.252,"15min":1.2270000000000001},"min":{"1min":0.30499999999999999,"5min":0.27400000000000002,"15min":0.222},"max":{"1min":14.000999999999999,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.81899999999999995},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":4.4089999999999998,"5min":8.7699999999999996,"15min":12.529},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.52400000000000002,"15min":0.64100000000000001},"min":{"1min":0.25800000000000001,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":5.8310000000000004,"5min":5.8310000000000004,"15min":12.388},"last":0.371}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5789757440,"data_stored":7065097746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9195360256,"data_stored":11208416043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3405242368,"data_stored":4143007001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:41:35.478 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:41:35.478 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:41:35.478 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:41:35.478 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:41:38.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:38.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:38.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:38.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:38.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:38.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:38.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:38.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:38.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:38.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:38.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:38.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:38.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:38.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:40.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:40.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:41:40.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:40.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:40.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:40.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:40.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:40.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:40.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:40.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:40.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:40.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:40.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:40.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:40.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:40.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:40.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:40.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:41.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:41.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:41:41.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:41.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:41.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:41.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:41.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:41.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:41.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:41.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:41.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:41.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:41.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:41.139+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:41.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:41.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:41.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:41.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:41.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:41.175+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:43.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:43.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:44.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:43.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:44.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:44.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:44.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:44.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:44.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:44.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:44.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:44.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:44.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:44.075+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:44.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:44.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:47.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:47.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:47.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:47.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:47.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:47.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:47.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:47.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:47.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:47.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.767+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:47.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:47.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:47.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:47.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:47.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.859+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:47.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:47.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:47.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:49.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:49.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:49.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:49.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:49.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:49.339+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:49.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:49.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:49.376 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:49.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:49.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:49.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:49.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:49.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:49.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:49.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:49.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:49.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:50.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.123+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:41:50.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.163+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:50.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:50.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.199+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:50.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.215+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:50.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:50.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:50.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:50.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.311+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:50.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:50.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:50.315+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:50.434 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:50.427+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:41:50.434 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:50.427+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:41:53.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:53.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:53.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:53.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:53.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:53.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:53.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:53.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:53.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:53.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:53.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:41:53.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:41:53.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:53.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:53.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:53.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:53.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:53.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:53.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:53.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:53.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:53.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:53.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:55.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:55.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:55.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:55.480 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:41:55.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:55.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:55.568 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:55.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:55.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:55.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:55.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:55.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:55.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:55.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:55.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:55.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:55.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:55.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:55.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.831+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:55.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:55.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:55.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:55.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:41:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:55.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:41:56.187 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:41:56.254 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2642,"stamp":"2023-09-23T08:41:54.590173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23551032651,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2414120,"num_read_kb":9502062,"num_write":2393163,"num_write_kb":9573023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80593,"ondisk_log_size":80593,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23120952,"kb_used_data":17995856,"kb_used_omap":1644,"kb_used_meta":5123411,"kb_avail":259994568,"statfs":{"total":289910292480,"available":266234437632,"internally_reserved":0,"allocated":18427756544,"data_stored":22448744485,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1684073,"internal_metadata":5246373271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,4,3,6,13,21,13,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11718656,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5765,"num_read_kb":23008,"num_write":5720,"num_write_kb":22880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003400"},"pg_stats":[{"pgid":"2.7","version":"88'297204","reported_seq":583770,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:53.614353+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:41:53.614353+0000","last_peered":"2023-09-23T08:41:53.614353+0000","last_clean":"2023-09-23T08:41:53.614353+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:41:53.614353+0000","last_undegraded":"2023-09-23T08:41:53.614353+0000","last_fullsized":"2023-09-23T08:41:53.614353+0000","mapping_epoch":13,"log_start":"88'287111","ondisk_log_start":"88'287111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2775851343,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":285540,"num_read_kb":1123946,"num_write":282045,"num_write_kb":1128084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'327245","reported_seq":643432,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:41:53.612164+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:41:53.612164+0000","last_peered":"2023-09-23T08:41:53.612164+0000","last_clean":"2023-09-23T08:41:53.612164+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:41:53.612164+0000","last_undegraded":"2023-09-23T08:41:53.612164+0000","last_fullsized":"2023-09-23T08:41:53.612164+0000","mapping_epoch":13,"log_start":"88'317207","ondisk_log_start":"88'317207","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":522,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 262s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3101303103,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":316052,"num_read_kb":1239970,"num_write":312564,"num_write_kb":1250025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'309571","reported_seq":607179,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:41:53.594852+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:41:53.594852+0000","last_peered":"2023-09-23T08:41:53.594852+0000","last_clean":"2023-09-23T08:41:53.594852+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:41:53.594852+0000","last_undegraded":"2023-09-23T08:41:53.594852+0000","last_fullsized":"2023-09-23T08:41:53.594852+0000","mapping_epoch":13,"log_start":"88'299510","ondisk_log_start":"88'299510","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":470,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 210s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2887409964,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":296683,"num_read_kb":1167785,"num_write":294896,"num_write_kb":1179497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'315284","reported_seq":630144,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:41:53.604941+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:41:53.604941+0000","last_peered":"2023-09-23T08:41:53.604941+0000","last_clean":"2023-09-23T08:41:53.604941+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:41:53.604941+0000","last_undegraded":"2023-09-23T08:41:53.604941+0000","last_fullsized":"2023-09-23T08:41:53.604941+0000","mapping_epoch":13,"log_start":"88'305211","ondisk_log_start":"88'305211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1174,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 597s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3090022682,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":315265,"num_read_kb":1246923,"num_write":313756,"num_write_kb":1254937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'307362","reported_seq":613111,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:52.746940+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:41:52.746940+0000","last_peered":"2023-09-23T08:41:52.746940+0000","last_clean":"2023-09-23T08:41:52.746940+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:41:52.746940+0000","last_undegraded":"2023-09-23T08:41:52.746940+0000","last_fullsized":"2023-09-23T08:41:52.746940+0000","mapping_epoch":13,"log_start":"88'297309","ondisk_log_start":"88'297309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2981970238,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":305278,"num_read_kb":1201863,"num_write":303766,"num_write_kb":1214914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'317673","reported_seq":631752,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:52.609746+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:41:52.609746+0000","last_peered":"2023-09-23T08:41:52.609746+0000","last_clean":"2023-09-23T08:41:52.609746+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:41:52.609746+0000","last_undegraded":"2023-09-23T08:41:52.609746+0000","last_fullsized":"2023-09-23T08:41:52.609746+0000","mapping_epoch":13,"log_start":"88'307611","ondisk_log_start":"88'307611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3071398358,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":313070,"num_read_kb":1231628,"num_write":310498,"num_write_kb":1241872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'290673","reported_seq":578114,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:52.617534+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:41:52.617534+0000","last_peered":"2023-09-23T08:41:52.617534+0000","last_clean":"2023-09-23T08:41:52.617534+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:41:52.617534+0000","last_undegraded":"2023-09-23T08:41:52.617534+0000","last_fullsized":"2023-09-23T08:41:52.617534+0000","mapping_epoch":13,"log_start":"88'280608","ondisk_log_start":"88'280608","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2785349933,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":286369,"num_read_kb":1126617,"num_write":283552,"num_write_kb":1134121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'307155","reported_seq":603855,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:41:53.534441+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:41:53.534441+0000","last_peered":"2023-09-23T08:41:53.534441+0000","last_clean":"2023-09-23T08:41:53.534441+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:41:53.534441+0000","last_undegraded":"2023-09-23T08:41:53.534441+0000","last_fullsized":"2023-09-23T08:41:53.534441+0000","mapping_epoch":13,"log_start":"88'297106","ondisk_log_start":"88'297106","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2857136662,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":295757,"num_read_kb":1163239,"num_write":291949,"num_write_kb":1167679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":266,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:36.793590+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:38:36.793590+0000","last_peered":"2023-09-23T08:38:36.793590+0000","last_clean":"2023-09-23T08:38:36.793590+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:38:36.793590+0000","last_undegraded":"2023-09-23T08:38:36.793590+0000","last_fullsized":"2023-09-23T08:38:36.793590+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23550442283,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2414014,"num_read_kb":9501971,"num_write":2393026,"num_write_kb":9571129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18425901056,"data_stored":22447081046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80494,"ondisk_log_size":80494,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739391,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080952,"kb_used_data":3332204,"kb_used_omap":319,"kb_used_meta":1748416,"kb_avail":89290888,"statfs":{"total":96636764160,"available":91433869312,"internally_reserved":0,"allocated":3412176896,"data_stored":4148619678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1790378220},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,0,0,3,3,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.81599999999999995,"15min":0.751},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.184},"max":{"1min":4.3140000000000001,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.91100000000000003,"15min":0.71399999999999997},"min":{"1min":0.214,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.7009999999999996,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.307}]},{"osd":1,"last update":"Sat Sep 23 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.173,"15min":1.0669999999999999},"min":{"1min":0.25900000000000001,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":8.7210000000000001,"5min":10.759,"15min":10.759},"last":2.536},{"interface":"front","average":{"1min":1.494,"5min":1.468,"15min":1.27},"min":{"1min":0.24099999999999999,"5min":0.184,"15min":0.184},"max":{"1min":10.766999999999999,"5min":12.379,"15min":14.311999999999999},"last":0.63800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739377,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10090548,"kb_used_data":8997984,"kb_used_omap":856,"kb_used_meta":1091687,"kb_avail":84281292,"statfs":{"total":96636764160,"available":86304043008,"internally_reserved":0,"allocated":9213935616,"data_stored":11224592848,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1117888378},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,1,5,7,10,4,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.76300000000000001,"15min":0.871},"min":{"1min":0.215,"5min":0.20799999999999999,"15min":0.191},"max":{"1min":1.274,"5min":9.9459999999999997,"15min":21.216000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.411,"15min":1.325},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.17599999999999999},"max":{"1min":7.2039999999999997,"5min":10.022,"15min":21.388999999999999},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.67900000000000005,"15min":0.85299999999999998},"min":{"1min":0.219,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":7.3600000000000003,"5min":7.3600000000000003,"15min":10.798999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.101,"5min":0.84799999999999998,"15min":0.873},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":7.4000000000000004,"5min":7.4000000000000004,"15min":11.98},"last":0.55300000000000005}]}]},{"osd":0,"up_from":8,"seq":34359739386,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7949452,"kb_used_data":5665668,"kb_used_omap":468,"kb_used_meta":2283307,"kb_avail":86422388,"statfs":{"total":96636764160,"available":88496525312,"internally_reserved":0,"allocated":5801644032,"data_stored":7075531959,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":479951,"internal_metadata":2338106673},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,3,8,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0840000000000001,"15min":1.119},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17299999999999999},"max":{"1min":4.5499999999999998,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":1.119,"5min":1.218,"15min":1.246},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":4.585,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77200000000000002,"15min":0.81899999999999995},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":4.4089999999999998,"5min":8.7699999999999996,"15min":12.529},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.52400000000000002,"15min":0.64100000000000001},"min":{"1min":0.25800000000000001,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":5.8310000000000004,"5min":5.8310000000000004,"15min":12.388},"last":0.314}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5800964096,"data_stored":7074743826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9213288448,"data_stored":11223833387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3411648512,"data_stored":4148503833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:41:56.255 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:41:56.255 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:41:56.256 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:41:56.256 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:41:57.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:57.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:41:57.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:57.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:57.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:57.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:57.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:57.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:41:57.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:57.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:57.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:57.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:57.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:57.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:57.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:57.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:57.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:57.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:58.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:58.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:58.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:58.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:58.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:58.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:58.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:58.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:58.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:58.683+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:58.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:58.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:41:59.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:59.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:41:59.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:59.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:41:59.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:59.275+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:41:59.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:59.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:41:59.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:59.363+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:41:59.374 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:41:59.363+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:41:59.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:59.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:41:59.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:59.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:41:59.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:41:59.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:02.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:02.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:03.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:03.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:03.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.055+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:03.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:03.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:03.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:03.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:03.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.723+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:03.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:03.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:03.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:03.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:03.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:03.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:05.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:05.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:05.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:05.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:05.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:05.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:05.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:05.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:05.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:05.043+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:05.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:05.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:05.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:05.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:06.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:06.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:06.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:06.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:06.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:06.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:06.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:06.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:06.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:06.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:06.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:06.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:06.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.811+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:06.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:06.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:06.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:11.595 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:42:11.583+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:42:11.595 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:42:11.583+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:42:13.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:13.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:13.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:13.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:13.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.655+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:13.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.663+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:13.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:13.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:13.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:13.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:13.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:13.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:13.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:14.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:14.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:14.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:14.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:14.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:14.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:14.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:14.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:14.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:14.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:14.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:14.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:16.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:42:16.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:16.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:16.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:16.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:16.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:16.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:16.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:16.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:16.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:16.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:16.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:16.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:16.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:16.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:16.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:16.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:17.086 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:42:17.086 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:42:17.125 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2653,"stamp":"2023-09-23T08:42:16.593914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23567183179,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2421622,"num_read_kb":9532046,"num_write":2400710,"num_write_kb":9603211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80538,"ondisk_log_size":80538,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22753796,"kb_used_data":18031528,"kb_used_omap":1644,"kb_used_meta":4720595,"kb_avail":260361724,"statfs":{"total":289910292480,"available":266610405376,"internally_reserved":0,"allocated":18464284672,"data_stored":22480111653,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1684073,"internal_metadata":4833889687},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,5,7,4,14,11,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8155136,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3715,"num_read_kb":14844,"num_write":3832,"num_write_kb":15328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002021"},"pg_stats":[{"pgid":"2.7","version":"88'298131","reported_seq":585550,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:14.187800+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:42:14.187800+0000","last_peered":"2023-09-23T08:42:14.187800+0000","last_clean":"2023-09-23T08:42:14.187800+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:42:14.187800+0000","last_undegraded":"2023-09-23T08:42:14.187800+0000","last_fullsized":"2023-09-23T08:42:14.187800+0000","mapping_epoch":13,"log_start":"88'288111","ondisk_log_start":"88'288111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2777776463,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":286381,"num_read_kb":1127310,"num_write":282930,"num_write_kb":1131624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'328322","reported_seq":645552,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:42:14.194678+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:42:14.194678+0000","last_peered":"2023-09-23T08:42:14.194678+0000","last_clean":"2023-09-23T08:42:14.194678+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:42:14.194678+0000","last_undegraded":"2023-09-23T08:42:14.194678+0000","last_fullsized":"2023-09-23T08:42:14.194678+0000","mapping_epoch":13,"log_start":"88'318307","ondisk_log_start":"88'318307","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":568,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 282s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3103539519,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":317078,"num_read_kb":1244070,"num_write":313575,"num_write_kb":1254069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'310604","reported_seq":609160,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:42:14.204574+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:42:14.204574+0000","last_peered":"2023-09-23T08:42:14.204574+0000","last_clean":"2023-09-23T08:42:14.204574+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:42:14.204574+0000","last_undegraded":"2023-09-23T08:42:14.204574+0000","last_fullsized":"2023-09-23T08:42:14.204574+0000","mapping_epoch":13,"log_start":"88'300510","ondisk_log_start":"88'300510","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":505,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 231s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2889457964,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":297608,"num_read_kb":1171473,"num_write":295869,"num_write_kb":1183389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'316301","reported_seq":632192,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:42:14.161791+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:42:14.161791+0000","last_peered":"2023-09-23T08:42:14.161791+0000","last_clean":"2023-09-23T08:42:14.161791+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:42:14.161791+0000","last_undegraded":"2023-09-23T08:42:14.161791+0000","last_fullsized":"2023-09-23T08:42:14.161791+0000","mapping_epoch":13,"log_start":"88'306211","ondisk_log_start":"88'306211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1226,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 618s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3091947802,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":316289,"num_read_kb":1251015,"num_write":314739,"num_write_kb":1258869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'308309","reported_seq":615072,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:12.875863+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:42:12.875863+0000","last_peered":"2023-09-23T08:42:12.875863+0000","last_clean":"2023-09-23T08:42:12.875863+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:42:12.875863+0000","last_undegraded":"2023-09-23T08:42:12.875863+0000","last_fullsized":"2023-09-23T08:42:12.875863+0000","mapping_epoch":13,"log_start":"88'298209","ondisk_log_start":"88'298209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2983973182,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":306285,"num_read_kb":1205891,"num_write":304707,"num_write_kb":1218678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'318655","reported_seq":633622,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:12.788878+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:42:12.788878+0000","last_peered":"2023-09-23T08:42:12.788878+0000","last_clean":"2023-09-23T08:42:12.788878+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:42:12.788878+0000","last_undegraded":"2023-09-23T08:42:12.788878+0000","last_fullsized":"2023-09-23T08:42:12.788878+0000","mapping_epoch":13,"log_start":"88'308611","ondisk_log_start":"88'308611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3073479126,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":313949,"num_read_kb":1235144,"num_write":311456,"num_write_kb":1245704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'291563","reported_seq":579885,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:12.769869+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:42:12.769869+0000","last_peered":"2023-09-23T08:42:12.769869+0000","last_clean":"2023-09-23T08:42:12.769869+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:42:12.769869+0000","last_undegraded":"2023-09-23T08:42:12.769869+0000","last_fullsized":"2023-09-23T08:42:12.769869+0000","mapping_epoch":13,"log_start":"88'281508","ondisk_log_start":"88'281508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2787250477,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":287236,"num_read_kb":1130081,"num_write":284418,"num_write_kb":1137585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'308127","reported_seq":605773,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:14.148924+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:42:14.148924+0000","last_peered":"2023-09-23T08:42:14.148924+0000","last_clean":"2023-09-23T08:42:14.148924+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:42:14.148924+0000","last_undegraded":"2023-09-23T08:42:14.148924+0000","last_fullsized":"2023-09-23T08:42:14.148924+0000","mapping_epoch":13,"log_start":"88'298106","ondisk_log_start":"88'298106","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2859168278,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":296690,"num_read_kb":1166971,"num_write":292879,"num_write_kb":1171399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":266,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:36.793590+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:38:36.793590+0000","last_peered":"2023-09-23T08:38:36.793590+0000","last_clean":"2023-09-23T08:38:36.793590+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:38:36.793590+0000","last_undegraded":"2023-09-23T08:38:36.793590+0000","last_fullsized":"2023-09-23T08:38:36.793590+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23566592811,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2421516,"num_read_kb":9531955,"num_write":2400573,"num_write_kb":9601317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18462924800,"data_stored":22478866006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80439,"ondisk_log_size":80439,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739395,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5155652,"kb_used_data":3338876,"kb_used_omap":319,"kb_used_meta":1816448,"kb_avail":89216188,"statfs":{"total":96636764160,"available":91357376512,"internally_reserved":0,"allocated":3419009024,"data_stored":4154456478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1860042988},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.81599999999999995,"15min":0.751},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.184},"max":{"1min":4.3140000000000001,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":0.22},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.91100000000000003,"15min":0.71399999999999997},"min":{"1min":0.214,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.7009999999999996,"5min":14.997999999999999,"15min":14.997999999999999},"last":1.897}]},{"osd":1,"last update":"Sat Sep 23 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.173,"15min":1.0669999999999999},"min":{"1min":0.25900000000000001,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":8.7210000000000001,"5min":10.759,"15min":10.759},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.468,"15min":1.27},"min":{"1min":0.24099999999999999,"5min":0.184,"15min":0.184},"max":{"1min":10.766999999999999,"5min":12.379,"15min":14.311999999999999},"last":2.1339999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739381,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10232764,"kb_used_data":9015920,"kb_used_omap":856,"kb_used_meta":1215975,"kb_avail":84139076,"statfs":{"total":96636764160,"available":86158413824,"internally_reserved":0,"allocated":9232302080,"data_stored":11240358352,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1245159290},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,3,3,3,13,9,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.76300000000000001,"15min":0.871},"min":{"1min":0.215,"5min":0.20799999999999999,"15min":0.191},"max":{"1min":1.274,"5min":9.9459999999999997,"15min":21.216000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.411,"15min":1.325},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.17599999999999999},"max":{"1min":7.2039999999999997,"5min":10.022,"15min":21.388999999999999},"last":0.23599999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.67900000000000005,"15min":0.85299999999999998},"min":{"1min":0.219,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":7.3600000000000003,"5min":7.3600000000000003,"15min":10.798999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":1.101,"5min":0.84799999999999998,"15min":0.873},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.23000000000000001},"max":{"1min":7.4000000000000004,"5min":7.4000000000000004,"15min":11.98},"last":0.37}]}]},{"osd":0,"up_from":8,"seq":34359739390,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7365380,"kb_used_data":5676732,"kb_used_omap":468,"kb_used_meta":1688171,"kb_avail":87006460,"statfs":{"total":96636764160,"available":89094615040,"internally_reserved":0,"allocated":5812973568,"data_stored":7085296823,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":479951,"internal_metadata":1728687409},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,4,1,1,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0840000000000001,"15min":1.119},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17299999999999999},"max":{"1min":4.5499999999999998,"5min":17.216000000000001,"15min":17.216000000000001},"last":2.2599999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.218,"15min":1.246},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":4.585,"5min":17.251000000000001,"15min":17.251000000000001},"last":2.2959999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.23799999999999999,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":3.907,"5min":8.7699999999999996,"15min":12.529},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.47399999999999998,"15min":0.63700000000000001},"min":{"1min":0.25,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":0.46400000000000002,"5min":5.8310000000000004,"15min":12.388},"last":0.25}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5812334592,"data_stored":7084545554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9232097280,"data_stored":11239983915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3418492928,"data_stored":4154336537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:42:17.127 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:42:17.127 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:42:17.128 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:42:17.128 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:42:19.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:19.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:21.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:21.619+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:21.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:21.667+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:21.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:21.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:21.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:21.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:21.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:21.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:21.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:21.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:21.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:21.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:21.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:21.755+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:23.436 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:23.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:23.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:23.431+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:23.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:23.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:23.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:23.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:23.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:23.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:23.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:23.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:24.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:24.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:24.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:24.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:24.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:24.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:24.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:24.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:24.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:24.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:24.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:24.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:24.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:24.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:26.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:26.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:26.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:26.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:26.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:26.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:26.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:26.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:26.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:26.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:29.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:29.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:29.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:29.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:29.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:29.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:29.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:29.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:29.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:29.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:29.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:29.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:29.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:29.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:29.585 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:42:29.574+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:42:29.586 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:42:29.574+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:42:30.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:42:30.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:30.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:30.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:30.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:30.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:30.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:30.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:30.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:30.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:30.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:30.502 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:42:30.494+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:42:30.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:30.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:30.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:30.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:30.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:30.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:30.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:30.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:30.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:30.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:30.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:30.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:31.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:31.014+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:31.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:31.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:31.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:31.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:31.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:31.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:31.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:31.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:31.049 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:31.042+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:31.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:31.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:31.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:31.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:31.908 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:42:31.902+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:42:31.908 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:42:31.902+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:42:31.908 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:42:31.902+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:42:32.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:32.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:32.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:32.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:32.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:32.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:32.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:32.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:32.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:32.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:32.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:32.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:33.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:42:33.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:33.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:33.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:33.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:33.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:33.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:33.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:33.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:33.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:33.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:33.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:33.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:33.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:35.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:42:35.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:35.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:35.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:35.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:35.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:35.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:35.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:35.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:35.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:35.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:35.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:35.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:35.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:35.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:35.960 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:35.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:35.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:35.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:36.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:36.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:36.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:36.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:36.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:36.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:36.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:36.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:36.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:36.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:36.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:36.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:36.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:36.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:36.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:36.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:36.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:36.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:36.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:36.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:37.129 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:42:37.722 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:42:37.722 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:42:37.766 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2663,"stamp":"2023-09-23T08:42:36.597926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23582821707,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2429096,"num_read_kb":9561898,"num_write":2408378,"num_write_kb":9633883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80446,"ondisk_log_size":80446,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23036800,"kb_used_data":18067092,"kb_used_omap":1644,"kb_used_meta":4968019,"kb_avail":260078720,"statfs":{"total":289910292480,"available":266320609280,"internally_reserved":0,"allocated":18500702208,"data_stored":22511265829,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1684073,"internal_metadata":5087251863},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,3,10,16,15,20],"upper_bound":256},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10076160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4851,"num_read_kb":19384,"num_write":4980,"num_write_kb":19920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001962"},"pg_stats":[{"pgid":"2.7","version":"88'299110","reported_seq":587443,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:34.892601+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:42:34.892601+0000","last_peered":"2023-09-23T08:42:34.892601+0000","last_clean":"2023-09-23T08:42:34.892601+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:42:34.892601+0000","last_undegraded":"2023-09-23T08:42:34.892601+0000","last_fullsized":"2023-09-23T08:42:34.892601+0000","mapping_epoch":13,"log_start":"88'289011","ondisk_log_start":"88'289011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2779681103,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":287283,"num_read_kb":1130914,"num_write":283864,"num_write_kb":1135360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'329399","reported_seq":647615,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:42:34.860126+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:42:34.860126+0000","last_peered":"2023-09-23T08:42:34.860126+0000","last_clean":"2023-09-23T08:42:34.860126+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:42:34.860126+0000","last_undegraded":"2023-09-23T08:42:34.860126+0000","last_fullsized":"2023-09-23T08:42:34.860126+0000","mapping_epoch":13,"log_start":"88'319307","ondisk_log_start":"88'319307","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":611,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 303s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3105632575,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":318042,"num_read_kb":1247926,"num_write":314581,"num_write_kb":1258093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'311645","reported_seq":611128,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:42:34.860028+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:42:34.860028+0000","last_peered":"2023-09-23T08:42:34.860028+0000","last_clean":"2023-09-23T08:42:34.860028+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:42:34.860028+0000","last_undegraded":"2023-09-23T08:42:34.860028+0000","last_fullsized":"2023-09-23T08:42:34.860028+0000","mapping_epoch":13,"log_start":"88'301610","ondisk_log_start":"88'301610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":567,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 251s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2891317548,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":298517,"num_read_kb":1175105,"num_write":296828,"num_write_kb":1187225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'317314","reported_seq":634201,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:42:34.856982+0000","last_change":"2023-09-23T08:31:55.762275+0000","last_active":"2023-09-23T08:42:34.856982+0000","last_peered":"2023-09-23T08:42:34.856982+0000","last_clean":"2023-09-23T08:42:34.856982+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:42:34.856982+0000","last_undegraded":"2023-09-23T08:42:34.856982+0000","last_fullsized":"2023-09-23T08:42:34.856982+0000","mapping_epoch":13,"log_start":"88'307312","ondisk_log_start":"88'307312","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1301,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 639s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3093905690,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":317275,"num_read_kb":1254947,"num_write":315704,"num_write_kb":1262729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'309249","reported_seq":616960,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:33.014752+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:42:33.014752+0000","last_peered":"2023-09-23T08:42:33.014752+0000","last_clean":"2023-09-23T08:42:33.014752+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:42:33.014752+0000","last_undegraded":"2023-09-23T08:42:33.014752+0000","last_fullsized":"2023-09-23T08:42:33.014752+0000","mapping_epoch":13,"log_start":"88'299209","ondisk_log_start":"88'299209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2985865534,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":307224,"num_read_kb":1209643,"num_write":305645,"num_write_kb":1222430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'319675","reported_seq":635638,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:32.874977+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:42:32.874977+0000","last_peered":"2023-09-23T08:42:32.874977+0000","last_clean":"2023-09-23T08:42:32.874977+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:42:32.874977+0000","last_undegraded":"2023-09-23T08:42:32.874977+0000","last_fullsized":"2023-09-23T08:42:32.874977+0000","mapping_epoch":13,"log_start":"88'309611","ondisk_log_start":"88'309611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3075568086,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":314930,"num_read_kb":1239064,"num_write":312452,"num_write_kb":1249688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'292518","reported_seq":581707,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:32.879947+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:42:32.879947+0000","last_peered":"2023-09-23T08:42:32.879947+0000","last_clean":"2023-09-23T08:42:32.879947+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:42:32.879947+0000","last_undegraded":"2023-09-23T08:42:32.879947+0000","last_fullsized":"2023-09-23T08:42:32.879947+0000","mapping_epoch":13,"log_start":"88'282508","ondisk_log_start":"88'282508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2789196077,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":288091,"num_read_kb":1133489,"num_write":285349,"num_write_kb":1141309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'309111","reported_seq":607702,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:34.837401+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:42:34.837401+0000","last_peered":"2023-09-23T08:42:34.837401+0000","last_clean":"2023-09-23T08:42:34.837401+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:42:34.837401+0000","last_undegraded":"2023-09-23T08:42:34.837401+0000","last_fullsized":"2023-09-23T08:42:34.837401+0000","mapping_epoch":13,"log_start":"88'299106","ondisk_log_start":"88'299106","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2861064726,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":297628,"num_read_kb":1170719,"num_write":293818,"num_write_kb":1175155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":266,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:38:36.793590+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:38:36.793590+0000","last_peered":"2023-09-23T08:38:36.793590+0000","last_clean":"2023-09-23T08:38:36.793590+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:38:36.793590+0000","last_undegraded":"2023-09-23T08:38:36.793590+0000","last_fullsized":"2023-09-23T08:38:36.793590+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23582231339,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2428990,"num_read_kb":9561807,"num_write":2408241,"num_write_kb":9631989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10206,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18499055616,"data_stored":22509749846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80347,"ondisk_log_size":80347,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739399,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5194156,"kb_used_data":3345508,"kb_used_omap":319,"kb_used_meta":1848320,"kb_avail":89177684,"statfs":{"total":96636764160,"available":91317948416,"internally_reserved":0,"allocated":3425800192,"data_stored":4160256414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1892679916},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,4,1,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.81599999999999995,"15min":0.751},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.184},"max":{"1min":4.3140000000000001,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.91100000000000003,"15min":0.71399999999999997},"min":{"1min":0.214,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":4.7009999999999996,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.86599999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.173,"15min":1.0669999999999999},"min":{"1min":0.25900000000000001,"5min":0.23899999999999999,"15min":0.21199999999999999},"max":{"1min":8.7210000000000001,"5min":10.759,"15min":10.759},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.494,"5min":1.468,"15min":1.27},"min":{"1min":0.24099999999999999,"5min":0.184,"15min":0.184},"max":{"1min":10.766999999999999,"5min":12.379,"15min":14.311999999999999},"last":2.3660000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739385,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10385680,"kb_used_data":9034172,"kb_used_omap":856,"kb_used_meta":1350631,"kb_avail":83986160,"statfs":{"total":96636764160,"available":86001827840,"internally_reserved":0,"allocated":9250992128,"data_stored":11256349136,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1383047034},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,1,6,8,12,17],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.65300000000000002,"15min":0.84199999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":0.70799999999999996,"5min":8.1600000000000001,"15min":21.216000000000001},"last":0.22},{"interface":"front","average":{"1min":1.272,"5min":1.409,"15min":1.3320000000000001},"min":{"1min":0.23599999999999999,"5min":0.189,"15min":0.17599999999999999},"max":{"1min":9.2270000000000003,"5min":9.2270000000000003,"15min":21.388999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.66800000000000004,"15min":0.83799999999999997},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.109,"5min":7.3600000000000003,"15min":10.798999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.78800000000000003,"15min":0.83899999999999997},"min":{"1min":0.26000000000000001,"5min":0.254,"15min":0.23000000000000001},"max":{"1min":0.76200000000000001,"5min":7.4000000000000004,"15min":11.98},"last":0.26800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739394,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7456964,"kb_used_data":5687412,"kb_used_omap":468,"kb_used_meta":1769067,"kb_avail":86914876,"statfs":{"total":96636764160,"available":89000833024,"internally_reserved":0,"allocated":5823909888,"data_stored":7094660279,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":479951,"internal_metadata":1811524913},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,4,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0840000000000001,"15min":1.119},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17299999999999999},"max":{"1min":4.5499999999999998,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.218,"15min":1.246},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":4.585,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.23799999999999999,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":3.907,"5min":8.7699999999999996,"15min":12.529},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.47399999999999998,"15min":0.63700000000000001},"min":{"1min":0.25,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":0.46400000000000002,"5min":5.8310000000000004,"15min":12.388},"last":0.28699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5823373312,"data_stored":7093974546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9250394112,"data_stored":11255618347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3425288192,"data_stored":4160156953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:42:37.768 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:42:37.768 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:42:37.768 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:42:37.769 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:42:38.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:38.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:38.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:38.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:38.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:38.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:38.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:38.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:38.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:38.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:38.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:38.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:38.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:38.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:38.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:38.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:38.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:38.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:38.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:38.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:39.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:39.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:39.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:39.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:39.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:39.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:39.421 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:39.435 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.430+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:39.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:39.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:39.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:39.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:39.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:39.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:39.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:39.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:40.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:40.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:40.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:40.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:40.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:40.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:40.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:40.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:40.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:40.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:40.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:40.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:40.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:40.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:41.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:41.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:42:41.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:41.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:41.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:41.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:41.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:41.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:41.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:41.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:41.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:41.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:41.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:41.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:41.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:41.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:41.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:41.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:43.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:43.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:43.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:43.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:43.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:43.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:43.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:43.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:44.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:43.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:44.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:43.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:45.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:45.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:45.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:45.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:45.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:45.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:45.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:45.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:45.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:45.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:45.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:45.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:45.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:45.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:47.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:47.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:42:47.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:47.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:47.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:47.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:47.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:47.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:47.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:47.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:47.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:47.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:47.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:47.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:47.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:47.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:47.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:47.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:49.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:49.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:49.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:49.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:49.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:49.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:49.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:49.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:49.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:49.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:49.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:49.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:49.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:49.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:49.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:49.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:49.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:49.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:49.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:49.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:50.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:50.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:50.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:50.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:50.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:50.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:50.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:50.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:50.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:50.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:50.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:50.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:50.370 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:50.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:50.978 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:50.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:51.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:51.022 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:51.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:51.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:51.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:51.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:51.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:51.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:51.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:51.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:51.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:51.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:51.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:51.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:51.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:51.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:51.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:51.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:51.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:51.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:51.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:51.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:51.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:51.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:51.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:52.059 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:42:52.050+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:42:52.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:52.270 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:52.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:52.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:52.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:52.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:52.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:52.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:52.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:52.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:52.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:52.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:52.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:52.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:53.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:53.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:53.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:53.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:53.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:53.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:53.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:53.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:53.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:53.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:53.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:53.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:53.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:53.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:54.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:42:54.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:54.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:54.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:54.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:54.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:54.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:54.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:54.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:54.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:54.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:54.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:55.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:55.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:55.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:55.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:55.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:55.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:55.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:55.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:55.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:55.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:55.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:55.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:55.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:55.306+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:55.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:55.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:56.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:56.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:56.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:56.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.654+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:56.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:56.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:56.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:56.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:56.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:56.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:42:56.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:56.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:56.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:56.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:56.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:56.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:56.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:56.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:56.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:56.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:57.770 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:42:58.250 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:42:58.242+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:42:58.250 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:42:58.242+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:42:58.567 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:42:58.567 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:42:58.617 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2673,"stamp":"2023-09-23T08:42:56.601381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23598853451,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2436431,"num_read_kb":9591222,"num_write":2416004,"num_write_kb":9664387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80515,"ondisk_log_size":80515,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23329992,"kb_used_data":18103152,"kb_used_omap":1644,"kb_used_meta":5225171,"kb_avail":259785528,"statfs":{"total":289910292480,"available":266020380672,"internally_reserved":0,"allocated":18537627648,"data_stored":22543140901,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1684073,"internal_metadata":5350575511},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,4,8,9,24,11,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10747904,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4785,"num_read_kb":19132,"num_write":5053,"num_write_kb":20212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002107"},"pg_stats":[{"pgid":"2.7","version":"88'300131","reported_seq":589388,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:55.721680+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:42:55.721680+0000","last_peered":"2023-09-23T08:42:55.721680+0000","last_clean":"2023-09-23T08:42:55.721680+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:42:55.721680+0000","last_undegraded":"2023-09-23T08:42:55.721680+0000","last_fullsized":"2023-09-23T08:42:55.721680+0000","mapping_epoch":13,"log_start":"88'290111","ondisk_log_start":"88'290111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2781663567,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":288198,"num_read_kb":1134574,"num_write":284822,"num_write_kb":1139192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'330462","reported_seq":649650,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:42:55.698182+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:42:55.698182+0000","last_peered":"2023-09-23T08:42:55.698182+0000","last_clean":"2023-09-23T08:42:55.698182+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:42:55.698182+0000","last_undegraded":"2023-09-23T08:42:55.698182+0000","last_fullsized":"2023-09-23T08:42:55.698182+0000","mapping_epoch":13,"log_start":"88'320407","ondisk_log_start":"88'320407","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":656,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 324s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3107643711,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":318997,"num_read_kb":1251746,"num_write":315552,"num_write_kb":1261977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'312655","reported_seq":613071,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:42:55.710965+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:42:55.710965+0000","last_peered":"2023-09-23T08:42:55.710965+0000","last_clean":"2023-09-23T08:42:55.710965+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:42:55.710965+0000","last_undegraded":"2023-09-23T08:42:55.710965+0000","last_fullsized":"2023-09-23T08:42:55.710965+0000","mapping_epoch":13,"log_start":"88'302610","ondisk_log_start":"88'302610","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":602,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 272s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2893226284,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":299429,"num_read_kb":1178749,"num_write":297754,"num_write_kb":1190929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'318374","reported_seq":636246,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:55.674842+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:42:55.674842+0000","last_peered":"2023-09-23T08:42:55.674842+0000","last_clean":"2023-09-23T08:42:55.674842+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:42:55.674842+0000","last_undegraded":"2023-09-23T08:42:55.674842+0000","last_fullsized":"2023-09-23T08:42:55.674842+0000","mapping_epoch":13,"log_start":"88'308312","ondisk_log_start":"88'308312","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3096138010,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":318250,"num_read_kb":1258843,"num_write":316751,"num_write_kb":1266917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'310183","reported_seq":618793,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:53.156463+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:42:53.156463+0000","last_peered":"2023-09-23T08:42:53.156463+0000","last_clean":"2023-09-23T08:42:53.156463+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:42:53.156463+0000","last_undegraded":"2023-09-23T08:42:53.156463+0000","last_fullsized":"2023-09-23T08:42:53.156463+0000","mapping_epoch":13,"log_start":"88'300109","ondisk_log_start":"88'300109","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2987807038,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":308115,"num_read_kb":1213199,"num_write":306575,"num_write_kb":1226150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'320633","reported_seq":637523,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:52.994715+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:42:52.994715+0000","last_peered":"2023-09-23T08:42:52.994715+0000","last_clean":"2023-09-23T08:42:52.994715+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:42:52.994715+0000","last_undegraded":"2023-09-23T08:42:52.994715+0000","last_fullsized":"2023-09-23T08:42:52.994715+0000","mapping_epoch":13,"log_start":"88'310611","ondisk_log_start":"88'310611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3077595606,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":315844,"num_read_kb":1242720,"num_write":313398,"num_write_kb":1253472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'293407","reported_seq":583447,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:52.995232+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:42:52.995232+0000","last_peered":"2023-09-23T08:42:52.995232+0000","last_clean":"2023-09-23T08:42:52.995232+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:42:52.995232+0000","last_undegraded":"2023-09-23T08:42:52.995232+0000","last_fullsized":"2023-09-23T08:42:52.995232+0000","mapping_epoch":13,"log_start":"88'283308","ondisk_log_start":"88'283308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2791051565,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":288929,"num_read_kb":1136841,"num_write":286226,"num_write_kb":1144817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'310145","reported_seq":609686,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:55.707611+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:42:55.707611+0000","last_peered":"2023-09-23T08:42:55.707611+0000","last_clean":"2023-09-23T08:42:55.707611+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:42:55.707611+0000","last_undegraded":"2023-09-23T08:42:55.707611+0000","last_fullsized":"2023-09-23T08:42:55.707611+0000","mapping_epoch":13,"log_start":"88'300106","ondisk_log_start":"88'300106","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2863137302,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":298563,"num_read_kb":1174459,"num_write":294789,"num_write_kb":1179039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":267,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:41.162521+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:40:41.162521+0000","last_peered":"2023-09-23T08:40:41.162521+0000","last_clean":"2023-09-23T08:40:41.162521+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:40:41.162521+0000","last_undegraded":"2023-09-23T08:40:41.162521+0000","last_fullsized":"2023-09-23T08:40:41.162521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23598263083,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2436325,"num_read_kb":9591131,"num_write":2415867,"num_write_kb":9662493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18536054784,"data_stored":22541669974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80416,"ondisk_log_size":80416,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739403,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5281184,"kb_used_data":3352024,"kb_used_omap":319,"kb_used_meta":1928832,"kb_avail":89090656,"statfs":{"total":96636764160,"available":91228831744,"internally_reserved":0,"allocated":3432472576,"data_stored":4166060446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":1975124204},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,5,2,4,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.80400000000000005,"15min":0.75600000000000001},"min":{"1min":0.21299999999999999,"5min":0.20599999999999999,"15min":0.184},"max":{"1min":0.82199999999999995,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.89300000000000002,"15min":0.72399999999999998},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":1.897,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.23899999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":1.1719999999999999,"15min":1.0589999999999999},"min":{"1min":0.252,"5min":0.248,"15min":0.21199999999999999},"max":{"1min":2.702,"5min":10.759,"15min":10.759},"last":1.236},{"interface":"front","average":{"1min":0.79400000000000004,"5min":1.3979999999999999,"15min":1.254},"min":{"1min":0.21199999999999999,"5min":0.184,"15min":0.184},"max":{"1min":2.7490000000000001,"5min":12.379,"15min":14.311999999999999},"last":1.208}]}]},{"osd":1,"up_from":8,"seq":34359739389,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10512196,"kb_used_data":9052732,"kb_used_omap":856,"kb_used_meta":1458599,"kb_avail":83859644,"statfs":{"total":96636764160,"available":85872275456,"internally_reserved":0,"allocated":9269997568,"data_stored":11272741328,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1493606266},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1,2,5,14,8,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.65300000000000002,"15min":0.84199999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":0.70799999999999996,"5min":8.1600000000000001,"15min":21.216000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.409,"15min":1.3320000000000001},"min":{"1min":0.23599999999999999,"5min":0.189,"15min":0.17599999999999999},"max":{"1min":9.2270000000000003,"5min":9.2270000000000003,"15min":21.388999999999999},"last":0.371}]},{"osd":2,"last update":"Sat Sep 23 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.66800000000000004,"15min":0.83799999999999997},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.109,"5min":7.3600000000000003,"15min":10.798999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.78800000000000003,"15min":0.83899999999999997},"min":{"1min":0.26000000000000001,"5min":0.254,"15min":0.23000000000000001},"max":{"1min":0.76200000000000001,"5min":7.4000000000000004,"15min":11.98},"last":0.317}]}]},{"osd":0,"up_from":8,"seq":34359739398,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7536612,"kb_used_data":5698396,"kb_used_omap":468,"kb_used_meta":1837739,"kb_avail":86835228,"statfs":{"total":96636764160,"available":88919273472,"internally_reserved":0,"allocated":5835157504,"data_stored":7104339127,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":479951,"internal_metadata":1881845041},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1,2,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.1399999999999999,"15min":1.1319999999999999},"min":{"1min":0.27900000000000003,"5min":0.17599999999999999,"15min":0.17299999999999999},"max":{"1min":3.8260000000000001,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":1.2749999999999999,"15min":1.2470000000000001},"min":{"1min":0.33200000000000002,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":3.863,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.41199999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.23799999999999999,"5min":0.20100000000000001,"15min":0.193},"max":{"1min":3.907,"5min":8.7699999999999996,"15min":12.529},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.47399999999999998,"15min":0.63700000000000001},"min":{"1min":0.25,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":0.46400000000000002,"5min":5.8310000000000004,"15min":12.388},"last":0.38500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5834698752,"data_stored":7103714834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9269272576,"data_stored":11271904043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3432083456,"data_stored":4166051097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:42:58.619 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:42:58.619 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:42:58.619 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:42:59.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:42:59.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:42:59.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:42:59.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:59.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:59.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:42:59.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:42:59.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:59.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:42:59.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:42:59.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:42:59.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:42:59.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:42:59.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:42:59.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:42:59.638+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:00.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.266+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:43:00.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:43:00.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:00.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:00.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:00.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:00.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:00.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:00.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:00.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:00.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:00.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:01.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:00.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:01.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:01.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:01.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:01.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:01.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:01.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:01.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:01.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:01.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:01.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:01.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:01.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:01.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:03.044 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:03.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:03.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:03.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:03.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:03.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:03.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:03.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:03.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:03.122+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:03.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:03.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:03.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:03.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:03.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:03.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:03.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:03.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:04.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:04.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:43:04.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:04.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:04.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:04.578+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:04.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:04.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:04.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:04.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:04.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:04.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:04.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:04.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:04.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:04.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:05.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:05.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:05.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:05.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:05.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:05.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:05.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:05.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:05.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:05.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:05.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:05.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:05.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:05.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:05.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:05.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:05.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:05.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:05.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:05.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:43:06.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:06.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:06.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:06.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:06.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:06.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:06.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:06.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:06.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:06.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:06.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:06.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:06.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:06.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:06.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:06.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:06.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:06.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:06.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:06.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:07.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:07.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:07.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:07.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:07.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:07.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:07.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:07.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:07.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:07.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:07.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:07.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:09.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:09.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:09.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:09.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:09.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:09.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:09.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:09.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:09.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:09.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:09.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:09.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:09.546 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:09.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:09.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:09.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:09.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:09.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:09.590 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:09.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:10.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:10.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:10.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:10.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:10.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:10.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:10.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:10.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:10.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:10.054+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:10.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:10.906+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:10.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:10.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:10.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:10.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:11.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:10.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:11.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:11.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:11.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:11.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:11.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:11.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:11.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:11.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:11.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:11.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:11.887 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:43:11.878+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:43:11.887 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:43:11.878+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:43:11.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:11.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:11.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:11.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:11.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:11.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:12.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.354+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:43:12.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:43:12.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:12.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:12.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:12.466 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:12.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:12.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:12.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:12.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:12.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:12.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:12.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:15.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:15.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:15.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:15.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:15.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:15.334+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:15.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:15.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:15.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:15.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:15.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:15.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:15.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:15.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:15.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:15.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:15.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:15.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:15.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:15.378+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:17.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:17.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.062+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:17.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:17.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:17.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:17.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:17.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:17.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:17.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:17.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:17.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:17.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:17.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:18.620 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:43:19.173 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:43:19.166+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:43:19.173 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:43:19.166+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:43:19.173 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:43:19.166+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:43:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:43:19.237 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:43:19.284 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2684,"stamp":"2023-09-23T08:43:18.607811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23615847755,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2444787,"num_read_kb":9624638,"num_write":2424412,"num_write_kb":9698019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80442,"ondisk_log_size":80442,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23702816,"kb_used_data":18142900,"kb_used_omap":1644,"kb_used_meta":5558227,"kb_avail":259412704,"statfs":{"total":289910292480,"available":265638608896,"internally_reserved":0,"allocated":18578329600,"data_stored":22578366501,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1684073,"internal_metadata":5691624855},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,3,11,11,14,13,7],"upper_bound":512},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9183232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4666,"num_read_kb":18656,"num_write":4523,"num_write_kb":18092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001867"},"pg_stats":[{"pgid":"2.7","version":"88'301131","reported_seq":591325,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:16.395181+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:43:16.395181+0000","last_peered":"2023-09-23T08:43:16.395181+0000","last_clean":"2023-09-23T08:43:16.395181+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:43:16.395181+0000","last_undegraded":"2023-09-23T08:43:16.395181+0000","last_fullsized":"2023-09-23T08:43:16.395181+0000","mapping_epoch":13,"log_start":"88'291111","ondisk_log_start":"88'291111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2783555919,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":289122,"num_read_kb":1138266,"num_write":285768,"num_write_kb":1142976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'331547","reported_seq":651787,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:43:16.371301+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:43:16.371301+0000","last_peered":"2023-09-23T08:43:16.371301+0000","last_clean":"2023-09-23T08:43:16.371301+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:43:16.371301+0000","last_undegraded":"2023-09-23T08:43:16.371301+0000","last_fullsized":"2023-09-23T08:43:16.371301+0000","mapping_epoch":13,"log_start":"88'321508","ondisk_log_start":"88'321508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":699,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 345s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3109605695,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":320028,"num_read_kb":1255870,"num_write":316555,"num_write_kb":1265989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'313750","reported_seq":615134,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:43:16.361220+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:43:16.361220+0000","last_peered":"2023-09-23T08:43:16.361220+0000","last_clean":"2023-09-23T08:43:16.361220+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:43:16.361220+0000","last_undegraded":"2023-09-23T08:43:16.361220+0000","last_fullsized":"2023-09-23T08:43:16.361220+0000","mapping_epoch":13,"log_start":"88'303710","ondisk_log_start":"88'303710","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":649,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 293s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2895311148,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":300382,"num_read_kb":1182561,"num_write":298765,"num_write_kb":1194973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'319349","reported_seq":638241,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:16.368392+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:43:16.368392+0000","last_peered":"2023-09-23T08:43:16.368392+0000","last_clean":"2023-09-23T08:43:16.368392+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:43:16.368392+0000","last_undegraded":"2023-09-23T08:43:16.368392+0000","last_fullsized":"2023-09-23T08:43:16.368392+0000","mapping_epoch":13,"log_start":"88'309312","ondisk_log_start":"88'309312","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3098063130,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":319270,"num_read_kb":1262923,"num_write":317726,"num_write_kb":1270817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'311404","reported_seq":621243,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:18.394290+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:43:18.394290+0000","last_peered":"2023-09-23T08:43:18.394290+0000","last_clean":"2023-09-23T08:43:18.394290+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:43:18.394290+0000","last_undegraded":"2023-09-23T08:43:18.394290+0000","last_fullsized":"2023-09-23T08:43:18.394290+0000","mapping_epoch":13,"log_start":"88'301309","ondisk_log_start":"88'301309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2990375230,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":309337,"num_read_kb":1218087,"num_write":307786,"num_write_kb":1230994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'321879","reported_seq":639988,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:18.169129+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:43:18.169129+0000","last_peered":"2023-09-23T08:43:18.169129+0000","last_clean":"2023-09-23T08:43:18.169129+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:43:18.169129+0000","last_undegraded":"2023-09-23T08:43:18.169129+0000","last_fullsized":"2023-09-23T08:43:18.169129+0000","mapping_epoch":13,"log_start":"88'311811","ondisk_log_start":"88'311811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3080147414,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":317051,"num_read_kb":1247548,"num_write":314626,"num_write_kb":1258384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'294520","reported_seq":585657,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:18.148616+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:43:18.148616+0000","last_peered":"2023-09-23T08:43:18.148616+0000","last_clean":"2023-09-23T08:43:18.148616+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:43:18.148616+0000","last_undegraded":"2023-09-23T08:43:18.148616+0000","last_fullsized":"2023-09-23T08:43:18.148616+0000","mapping_epoch":13,"log_start":"88'284508","ondisk_log_start":"88'284508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2793152813,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":290014,"num_read_kb":1141181,"num_write":287321,"num_write_kb":1149197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'311138","reported_seq":611603,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:16.335127+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:43:16.335127+0000","last_peered":"2023-09-23T08:43:16.335127+0000","last_clean":"2023-09-23T08:43:16.335127+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:43:16.335127+0000","last_undegraded":"2023-09-23T08:43:16.335127+0000","last_fullsized":"2023-09-23T08:43:16.335127+0000","mapping_epoch":13,"log_start":"88'301106","ondisk_log_start":"88'301106","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2865046038,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":299477,"num_read_kb":1178111,"num_write":295728,"num_write_kb":1182795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":267,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:41.162521+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:40:41.162521+0000","last_peered":"2023-09-23T08:40:41.162521+0000","last_clean":"2023-09-23T08:40:41.162521+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:40:41.162521+0000","last_undegraded":"2023-09-23T08:40:41.162521+0000","last_fullsized":"2023-09-23T08:40:41.162521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23615257387,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2444681,"num_read_kb":9624547,"num_write":2424275,"num_write_kb":9696125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18577178624,"data_stored":22577292886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80343,"ondisk_log_size":80343,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739408,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5361440,"kb_used_data":3360148,"kb_used_omap":319,"kb_used_meta":2000960,"kb_avail":89010400,"statfs":{"total":96636764160,"available":91146649600,"internally_reserved":0,"allocated":3440791552,"data_stored":4173273502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327444,"internal_metadata":2048983276},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.80400000000000005,"15min":0.75600000000000001},"min":{"1min":0.21299999999999999,"5min":0.20599999999999999,"15min":0.184},"max":{"1min":0.82199999999999995,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.89300000000000002,"15min":0.72399999999999998},"min":{"1min":0.24099999999999999,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":1.897,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.314}]},{"osd":1,"last update":"Sat Sep 23 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":1.1719999999999999,"15min":1.0589999999999999},"min":{"1min":0.252,"5min":0.248,"15min":0.21199999999999999},"max":{"1min":2.702,"5min":10.759,"15min":10.759},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":1.3979999999999999,"15min":1.254},"min":{"1min":0.21199999999999999,"5min":0.184,"15min":0.184},"max":{"1min":2.7490000000000001,"5min":12.379,"15min":14.311999999999999},"last":0.23300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739393,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10714360,"kb_used_data":9070308,"kb_used_omap":856,"kb_used_meta":1643175,"kb_avail":83657480,"statfs":{"total":96636764160,"available":85665259520,"internally_reserved":0,"allocated":9287995392,"data_stored":11288347088,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1682612090},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,2,7,6,7,12,7],"upper_bound":512},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.65300000000000002,"15min":0.84199999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":0.70799999999999996,"5min":8.1600000000000001,"15min":21.216000000000001},"last":0.22500000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.409,"15min":1.3320000000000001},"min":{"1min":0.23599999999999999,"5min":0.189,"15min":0.17599999999999999},"max":{"1min":9.2270000000000003,"5min":9.2270000000000003,"15min":21.388999999999999},"last":3.7400000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.66800000000000004,"15min":0.83799999999999997},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.109,"5min":7.3600000000000003,"15min":10.798999999999999},"last":1.095},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.78800000000000003,"15min":0.83899999999999997},"min":{"1min":0.26000000000000001,"5min":0.254,"15min":0.23000000000000001},"max":{"1min":0.76200000000000001,"5min":7.4000000000000004,"15min":11.98},"last":0.25700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739403,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7627016,"kb_used_data":5712444,"kb_used_omap":468,"kb_used_meta":1914091,"kb_avail":86744824,"statfs":{"total":96636764160,"available":88826699776,"internally_reserved":0,"allocated":5849542656,"data_stored":7116745911,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":479951,"internal_metadata":1960029489},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,4,5,7,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.1399999999999999,"15min":1.1319999999999999},"min":{"1min":0.27900000000000003,"5min":0.17599999999999999,"15min":0.17299999999999999},"max":{"1min":3.8260000000000001,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":1.2749999999999999,"15min":1.2470000000000001},"min":{"1min":0.33200000000000002,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":3.863,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.58299999999999996}]},{"osd":2,"last update":"Sat Sep 23 08:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.222,"5min":0.221,"15min":0.193},"max":{"1min":0.68899999999999995,"5min":8.7699999999999996,"15min":12.529},"last":0.374},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.5,"15min":0.627},"min":{"1min":0.26600000000000001,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":4.4169999999999998,"5min":5.8310000000000004,"15min":12.388},"last":0.318}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5849120768,"data_stored":7116187154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9287667712,"data_stored":11287833387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3440390144,"data_stored":4173272345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:43:19.285 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:43:19.286 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:43:19.286 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:43:19.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:19.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:19.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:19.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:19.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:19.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:19.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:19.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:43:19.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:19.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:19.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:19.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:19.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:21.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.582+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:43:21.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:43:21.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:21.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:21.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:21.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:21.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:21.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:21.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:21.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:21.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:21.757 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:21.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:22.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:22.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:22.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:22.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:22.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:22.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:22.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:22.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:22.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:22.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:22.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:22.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:22.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:22.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:22.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:22.222+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:22.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:22.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:22.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:22.230+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:23.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:23.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:23.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:23.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:23.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:23.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:23.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:23.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:23.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:23.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:23.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:23.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.826+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:23.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:23.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:23.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:23.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:23.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:43:23.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:23.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:23.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:24.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:23.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:24.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:24.022+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:24.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:24.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:24.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:24.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:24.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:24.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:24.205 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:43:24.202+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:43:28.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:28.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:28.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:28.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:28.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:28.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:28.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:28.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:28.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:28.178+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:28.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:28.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:28.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:28.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:28.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:28.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:28.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:28.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:28.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:28.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:29.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:29.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:29.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:29.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:29.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:29.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:29.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:29.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:29.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:29.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:33.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:33.002+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:33.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:33.070+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:33.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:33.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:33.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:33.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:33.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:33.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:33.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:33.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:33.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:33.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:33.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:33.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:33.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:33.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:34.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:34.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:34.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:34.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:34.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:34.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:34.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:34.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:34.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:34.881+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:34.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:34.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:34.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:34.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:39.287 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:43:39.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:43:39.631 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:39.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:39.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:39.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:39.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:39.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.649+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:39.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:39.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:39.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:39.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:39.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:39.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:39.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:39.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:39.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:39.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:39.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:39.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:39.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:39.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:39.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:43:40.084 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:43:40.125 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2694,"stamp":"2023-09-23T08:43:38.614891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23631433035,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2452289,"num_read_kb":9654646,"num_write":2431929,"num_write_kb":9728087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80732,"ondisk_log_size":80732,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23330624,"kb_used_data":18176772,"kb_used_omap":1646,"kb_used_meta":5152145,"kb_avail":259784896,"statfs":{"total":289910292480,"available":266019733504,"internally_reserved":0,"allocated":18613014528,"data_stored":22608238629,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1685753,"internal_metadata":5275797255},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,8,8,14,12,18],"upper_bound":256},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11522048,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5625,"num_read_kb":22500,"num_write":5613,"num_write_kb":22452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005811"},"pg_stats":[{"pgid":"2.7","version":"88'302078","reported_seq":593265,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:37.146590+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:43:37.146590+0000","last_peered":"2023-09-23T08:43:37.146590+0000","last_clean":"2023-09-23T08:43:37.146590+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:43:37.146590+0000","last_undegraded":"2023-09-23T08:43:37.146590+0000","last_fullsized":"2023-09-23T08:43:37.146590+0000","mapping_epoch":13,"log_start":"88'292011","ondisk_log_start":"88'292011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2785431887,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":290105,"num_read_kb":1142198,"num_write":286674,"num_write_kb":1146600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'332622","reported_seq":653885,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:43:37.152008+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:43:37.152008+0000","last_peered":"2023-09-23T08:43:37.152008+0000","last_clean":"2023-09-23T08:43:37.152008+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:43:37.152008+0000","last_undegraded":"2023-09-23T08:43:37.152008+0000","last_fullsized":"2023-09-23T08:43:37.152008+0000","mapping_epoch":13,"log_start":"88'322608","ondisk_log_start":"88'322608","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":749,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 365s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3111760191,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":321030,"num_read_kb":1259878,"num_write":317558,"num_write_kb":1270001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'314804","reported_seq":617184,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:43:37.150668+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:43:37.150668+0000","last_peered":"2023-09-23T08:43:37.150668+0000","last_clean":"2023-09-23T08:43:37.150668+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:43:37.150668+0000","last_undegraded":"2023-09-23T08:43:37.150668+0000","last_fullsized":"2023-09-23T08:43:37.150668+0000","mapping_epoch":13,"log_start":"88'304710","ondisk_log_start":"88'304710","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":708,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 314s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2897211692,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":301357,"num_read_kb":1186461,"num_write":299741,"num_write_kb":1198877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'320405","reported_seq":640299,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:37.125531+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:43:37.125531+0000","last_peered":"2023-09-23T08:43:37.125531+0000","last_clean":"2023-09-23T08:43:37.125531+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:43:37.125531+0000","last_undegraded":"2023-09-23T08:43:37.125531+0000","last_fullsized":"2023-09-23T08:43:37.125531+0000","mapping_epoch":13,"log_start":"88'310312","ondisk_log_start":"88'310312","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3100320026,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":320274,"num_read_kb":1266939,"num_write":318782,"num_write_kb":1275041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'312097","reported_seq":622652,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:33.539234+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:43:33.539234+0000","last_peered":"2023-09-23T08:43:33.539234+0000","last_clean":"2023-09-23T08:43:33.539234+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:43:33.539234+0000","last_undegraded":"2023-09-23T08:43:33.539234+0000","last_fullsized":"2023-09-23T08:43:33.539234+0000","mapping_epoch":13,"log_start":"88'302009","ondisk_log_start":"88'302009","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2991898942,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":310049,"num_read_kb":1220935,"num_write":308475,"num_write_kb":1233750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'322910","reported_seq":642016,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:38.288938+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:43:38.288938+0000","last_peered":"2023-09-23T08:43:38.288938+0000","last_clean":"2023-09-23T08:43:38.288938+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:43:38.288938+0000","last_undegraded":"2023-09-23T08:43:38.288938+0000","last_fullsized":"2023-09-23T08:43:38.288938+0000","mapping_epoch":13,"log_start":"88'312811","ondisk_log_start":"88'312811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3082265046,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":318036,"num_read_kb":1251488,"num_write":315639,"num_write_kb":1262436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'295388","reported_seq":587423,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:38.237860+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:43:38.237860+0000","last_peered":"2023-09-23T08:43:38.237860+0000","last_clean":"2023-09-23T08:43:38.237860+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:43:38.237860+0000","last_undegraded":"2023-09-23T08:43:38.237860+0000","last_fullsized":"2023-09-23T08:43:38.237860+0000","mapping_epoch":13,"log_start":"88'285308","ondisk_log_start":"88'285308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2794828077,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":290900,"num_read_kb":1144725,"num_write":288171,"num_write_kb":1152597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'312204","reported_seq":613640,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:37.072437+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:43:37.072437+0000","last_peered":"2023-09-23T08:43:37.072437+0000","last_clean":"2023-09-23T08:43:37.072437+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:43:37.072437+0000","last_undegraded":"2023-09-23T08:43:37.072437+0000","last_fullsized":"2023-09-23T08:43:37.072437+0000","mapping_epoch":13,"log_start":"88'302106","ondisk_log_start":"88'302106","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2867126806,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":300432,"num_read_kb":1181931,"num_write":296752,"num_write_kb":1186891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":267,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:41.162521+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:40:41.162521+0000","last_peered":"2023-09-23T08:40:41.162521+0000","last_clean":"2023-09-23T08:40:41.162521+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:40:41.162521+0000","last_undegraded":"2023-09-23T08:40:41.162521+0000","last_fullsized":"2023-09-23T08:40:41.162521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23630842667,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2452183,"num_read_kb":9654555,"num_write":2431792,"num_write_kb":9726193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18611388416,"data_stored":22606763606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80633,"ondisk_log_size":80633,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739412,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4912996,"kb_used_data":3367004,"kb_used_omap":321,"kb_used_meta":1545662,"kb_avail":89458844,"statfs":{"total":96636764160,"available":91605856256,"internally_reserved":0,"allocated":3447812096,"data_stored":4179360158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":1582758492},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,5,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.184},"max":{"1min":7.6130000000000004,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":1.131,"5min":0.92800000000000005,"15min":0.74299999999999999},"min":{"1min":0.23899999999999999,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":7.492,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.252}]},{"osd":1,"last update":"Sat Sep 23 08:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":1.1279999999999999,"15min":1.054},"min":{"1min":0.247,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":5.1859999999999999,"5min":10.759,"15min":10.759},"last":0.44700000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.518,"15min":1.2509999999999999},"min":{"1min":0.20999999999999999,"5min":0.184,"15min":0.184},"max":{"1min":5.7619999999999996,"5min":12.379,"15min":12.379},"last":2.952}]}]},{"osd":1,"up_from":8,"seq":34359739397,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10710120,"kb_used_data":9089036,"kb_used_omap":856,"kb_used_meta":1620199,"kb_avail":83661720,"statfs":{"total":96636764160,"available":85669601280,"internally_reserved":0,"allocated":9307172864,"data_stored":11304853968,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1659084666},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3,6,7,10,17],"upper_bound":256},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.45800000000000002,"15min":0.80600000000000005},"min":{"1min":0.214,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":1.0840000000000001,"5min":6.8689999999999998,"15min":21.216000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":1.1819999999999999,"15min":1.262},"min":{"1min":0.245,"5min":0.189,"15min":0.17599999999999999},"max":{"1min":4.3369999999999997,"5min":9.2270000000000003,"15min":21.388999999999999},"last":0.32300000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65600000000000003,"15min":0.79500000000000004},"min":{"1min":0.251,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.8289999999999997,"5min":7.3600000000000003,"15min":10.798999999999999},"last":3.4580000000000002},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.67400000000000004,"15min":0.80500000000000005},"min":{"1min":0.25700000000000001,"5min":0.254,"15min":0.23000000000000001},"max":{"1min":0.49299999999999999,"5min":7.4000000000000004,"15min":11.98},"last":0.30399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739406,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7707508,"kb_used_data":5720732,"kb_used_omap":468,"kb_used_meta":1986283,"kb_avail":86664332,"statfs":{"total":96636764160,"available":88744275968,"internally_reserved":0,"allocated":5858029568,"data_stored":7124024503,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":479951,"internal_metadata":2033954097},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.1399999999999999,"15min":1.1319999999999999},"min":{"1min":0.27900000000000003,"5min":0.17599999999999999,"15min":0.17299999999999999},"max":{"1min":3.8260000000000001,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":1.2749999999999999,"15min":1.2470000000000001},"min":{"1min":0.33200000000000002,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":3.863,"5min":17.251000000000001,"15min":17.251000000000001},"last":0.436}]},{"osd":2,"last update":"Sat Sep 23 08:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.222,"5min":0.221,"15min":0.193},"max":{"1min":0.68899999999999995,"5min":8.7699999999999996,"15min":12.529},"last":6.0960000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.5,"15min":0.627},"min":{"1min":0.26600000000000001,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":4.4169999999999998,"5min":5.8310000000000004,"15min":12.388},"last":0.38100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5857722368,"data_stored":7123564050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9306542080,"data_stored":11304094507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3447123968,"data_stored":4179105049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:43:40.127 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:43:40.127 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:43:40.127 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:43:40.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:40.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:40.185 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:40.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:40.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:40.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:40.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:40.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:40.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:40.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:40.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:40.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:40.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:40.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:40.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:40.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:40.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:42.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:42.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:42.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:42.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:42.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:42.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:42.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:42.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:42.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:42.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:42.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:42.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:42.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:42.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:42.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:42.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:42.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:42.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:42.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:42.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:43.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:43.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:43.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:43.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:43.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:43.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:43.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:43.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:43.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:43.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:43.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:43.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:43.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:43.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:43.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:43.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:46.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:46.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:46.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:46.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:46.677 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:46.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:46.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:46.673+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:46.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:46.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:46.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:46.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:48.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:48.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:48.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:48.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:48.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:48.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:48.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:48.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:48.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:48.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:48.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:48.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:48.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:48.401+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:48.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:48.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:48.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:48.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:48.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:48.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:49.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:49.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:49.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:49.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:49.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:49.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.085+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:49.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.093+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:49.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:49.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:49.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:43:49.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:49.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:49.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:50.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:50.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:50.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:50.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:50.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:50.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:50.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:50.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:50.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:50.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:50.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:50.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:50.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:50.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:50.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:50.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:50.898 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:43:50.893+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:43:50.898 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:43:50.893+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:43:50.898 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:43:50.893+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:43:53.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:53.281+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:53.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:53.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:53.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:53.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:53.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:53.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:53.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:53.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:53.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:53.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:53.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:53.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:53.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:53.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:53.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:54.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:54.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:54.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:54.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:54.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:54.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:55.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:55.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:55.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:55.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:55.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:55.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:55.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:55.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:55.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:55.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:55.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:55.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:55.967 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:55.965+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:55.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:55.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:55.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:55.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:56.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:56.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:56.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:56.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:56.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:56.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:56.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:56.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.465+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:56.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:56.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:56.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:56.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:56.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:56.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:56.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:56.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:57.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:57.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:43:57.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:57.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:43:57.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:57.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:57.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:57.665+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:57.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:57.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:57.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:57.677+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:57.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:57.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:57.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:57.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:57.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:57.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:57.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:57.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:43:58.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:58.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:43:58.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:58.929+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:43:58.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:58.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:43:58.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:58.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:43:58.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:58.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:43:58.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:58.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:43:59.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:59.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:43:59.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:59.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:43:59.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:59.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:43:59.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:43:59.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:00.128 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:44:00.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:00.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:00.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:00.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:00.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.625+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:00.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:00.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:00.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:00.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:00.728 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:00.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:00.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:01.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:01.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:01.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:01.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:01.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:01.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:01.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:01.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:01.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:01.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:01.145 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:44:01.146 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:44:01.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:01.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:01.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:01.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:01.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:01.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:01.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:01.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:01.215 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2705,"stamp":"2023-09-23T08:44:00.618450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23648013643,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2460343,"num_read_kb":9686850,"num_write":2439963,"num_write_kb":9760223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80378,"ondisk_log_size":80378,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23677488,"kb_used_data":18216268,"kb_used_omap":1646,"kb_used_meta":5459537,"kb_avail":259438032,"statfs":{"total":289910292480,"available":265664544768,"internally_reserved":0,"allocated":18653458432,"data_stored":22642968613,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1685753,"internal_metadata":5590566663},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,11,10,10,10,12,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8466432,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4210,"num_read_kb":16828,"num_write":4150,"num_write_kb":16600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001946"},"pg_stats":[{"pgid":"2.7","version":"88'303041","reported_seq":595202,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:57.916562+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:43:57.916562+0000","last_peered":"2023-09-23T08:43:57.916562+0000","last_clean":"2023-09-23T08:43:57.916562+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:43:57.916562+0000","last_undegraded":"2023-09-23T08:43:57.916562+0000","last_fullsized":"2023-09-23T08:43:57.916562+0000","mapping_epoch":13,"log_start":"88'293011","ondisk_log_start":"88'293011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2787336527,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":291067,"num_read_kb":1146046,"num_write":287586,"num_write_kb":1150248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'333721","reported_seq":655971,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:43:57.917066+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:43:57.917066+0000","last_peered":"2023-09-23T08:43:57.917066+0000","last_clean":"2023-09-23T08:43:57.917066+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:43:57.917066+0000","last_undegraded":"2023-09-23T08:43:57.917066+0000","last_fullsized":"2023-09-23T08:43:57.917066+0000","mapping_epoch":13,"log_start":"88'323708","ondisk_log_start":"88'323708","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":794,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 386s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3113939263,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":322000,"num_read_kb":1263758,"num_write":318578,"num_write_kb":1274081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'315835","reported_seq":619141,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:43:57.848288+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:43:57.848288+0000","last_peered":"2023-09-23T08:43:57.848288+0000","last_clean":"2023-09-23T08:43:57.848288+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:43:57.848288+0000","last_undegraded":"2023-09-23T08:43:57.848288+0000","last_fullsized":"2023-09-23T08:43:57.848288+0000","mapping_epoch":13,"log_start":"88'305810","ondisk_log_start":"88'305810","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":762,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 334s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2899194156,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":302265,"num_read_kb":1190093,"num_write":300687,"num_write_kb":1202661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'321447","reported_seq":642383,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:57.880820+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:43:57.880820+0000","last_peered":"2023-09-23T08:43:57.880820+0000","last_clean":"2023-09-23T08:43:57.880820+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:43:57.880820+0000","last_undegraded":"2023-09-23T08:43:57.880820+0000","last_fullsized":"2023-09-23T08:43:57.880820+0000","mapping_epoch":13,"log_start":"88'311412","ondisk_log_start":"88'311412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3102322970,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":321314,"num_read_kb":1271095,"num_write":319824,"num_write_kb":1279209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'313360","reported_seq":625191,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:58.847458+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:43:58.847458+0000","last_peered":"2023-09-23T08:43:58.847458+0000","last_clean":"2023-09-23T08:43:58.847458+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:43:58.847458+0000","last_undegraded":"2023-09-23T08:43:58.847458+0000","last_fullsized":"2023-09-23T08:43:58.847458+0000","mapping_epoch":13,"log_start":"88'303309","ondisk_log_start":"88'303309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2994491710,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":311312,"num_read_kb":1225983,"num_write":309728,"num_write_kb":1238762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'323916","reported_seq":644024,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:58.464223+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:43:58.464223+0000","last_peered":"2023-09-23T08:43:58.464223+0000","last_clean":"2023-09-23T08:43:58.464223+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:43:58.464223+0000","last_undegraded":"2023-09-23T08:43:58.464223+0000","last_fullsized":"2023-09-23T08:43:58.464223+0000","mapping_epoch":13,"log_start":"88'313911","ondisk_log_start":"88'313911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3084374486,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":319025,"num_read_kb":1255444,"num_write":316627,"num_write_kb":1266388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'296364","reported_seq":589386,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:58.458586+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:43:58.458586+0000","last_peered":"2023-09-23T08:43:58.458586+0000","last_clean":"2023-09-23T08:43:58.458586+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:43:58.458586+0000","last_undegraded":"2023-09-23T08:43:58.458586+0000","last_fullsized":"2023-09-23T08:43:58.458586+0000","mapping_epoch":13,"log_start":"88'286308","ondisk_log_start":"88'286308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2796794157,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":291875,"num_read_kb":1148625,"num_write":289129,"num_write_kb":1156429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'313170","reported_seq":615562,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:43:57.807875+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:43:57.807875+0000","last_peered":"2023-09-23T08:43:57.807875+0000","last_clean":"2023-09-23T08:43:57.807875+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:43:57.807875+0000","last_undegraded":"2023-09-23T08:43:57.807875+0000","last_fullsized":"2023-09-23T08:43:57.807875+0000","mapping_epoch":13,"log_start":"88'303106","ondisk_log_start":"88'303106","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2868970006,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":301379,"num_read_kb":1185715,"num_write":297667,"num_write_kb":1190551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":267,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:41.162521+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:40:41.162521+0000","last_peered":"2023-09-23T08:40:41.162521+0000","last_clean":"2023-09-23T08:40:41.162521+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:40:41.162521+0000","last_undegraded":"2023-09-23T08:40:41.162521+0000","last_fullsized":"2023-09-23T08:40:41.162521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23647423275,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2460237,"num_read_kb":9686759,"num_write":2439826,"num_write_kb":9758329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18651488256,"data_stored":22641178198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80279,"ondisk_log_size":80279,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739416,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4975184,"kb_used_data":3373640,"kb_used_omap":321,"kb_used_meta":1601214,"kb_avail":89396656,"statfs":{"total":96636764160,"available":91542175744,"internally_reserved":0,"allocated":3454607360,"data_stored":4185143710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":1639643740},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,1,1,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.184},"max":{"1min":7.6130000000000004,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.131,"5min":0.92800000000000005,"15min":0.74299999999999999},"min":{"1min":0.23899999999999999,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":7.492,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.29799999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":1.1279999999999999,"15min":1.054},"min":{"1min":0.247,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":5.1859999999999999,"5min":10.759,"15min":10.759},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.518,"15min":1.2509999999999999},"min":{"1min":0.20999999999999999,"5min":0.184,"15min":0.184},"max":{"1min":5.7619999999999996,"5min":12.379,"15min":12.379},"last":1.073}]}]},{"osd":1,"up_from":8,"seq":34359739401,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10877124,"kb_used_data":9107508,"kb_used_omap":856,"kb_used_meta":1768743,"kb_avail":83494716,"statfs":{"total":96636764160,"available":85498589184,"internally_reserved":0,"allocated":9326088192,"data_stored":11321110992,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1811193722},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,6,6,6,6,9,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.45800000000000002,"15min":0.80600000000000005},"min":{"1min":0.214,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":1.0840000000000001,"5min":6.8689999999999998,"15min":21.216000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":1.1819999999999999,"15min":1.262},"min":{"1min":0.245,"5min":0.189,"15min":0.17599999999999999},"max":{"1min":4.3369999999999997,"5min":9.2270000000000003,"15min":21.388999999999999},"last":3.823}]},{"osd":2,"last update":"Sat Sep 23 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65600000000000003,"15min":0.79500000000000004},"min":{"1min":0.251,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.8289999999999997,"5min":7.3600000000000003,"15min":10.798999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.67400000000000004,"15min":0.80500000000000005},"min":{"1min":0.25700000000000001,"5min":0.254,"15min":0.23000000000000001},"max":{"1min":0.49299999999999999,"5min":7.4000000000000004,"15min":11.98},"last":3.4940000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739411,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7825180,"kb_used_data":5735120,"kb_used_omap":468,"kb_used_meta":2089579,"kb_avail":86546660,"statfs":{"total":96636764160,"available":88623779840,"internally_reserved":0,"allocated":5872762880,"data_stored":7136713911,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":479951,"internal_metadata":2139729201},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,4,3,3,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.97299999999999998,"15min":1.131},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":2.4289999999999998,"5min":5.5679999999999996,"15min":17.216000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":1.1040000000000001,"15min":1.226},"min":{"1min":0.224,"5min":0.224,"15min":0.222},"max":{"1min":2.4649999999999999,"5min":14.000999999999999,"15min":17.251000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.222,"5min":0.221,"15min":0.193},"max":{"1min":0.68899999999999995,"5min":8.7699999999999996,"15min":12.529},"last":2.1259999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.5,"15min":0.627},"min":{"1min":0.26600000000000001,"5min":0.24099999999999999,"15min":0.184},"max":{"1min":4.4169999999999998,"5min":5.8310000000000004,"15min":12.388},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5872070656,"data_stored":7135909394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9325400064,"data_stored":11320310571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3454017536,"data_stored":4184958233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:44:01.217 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:44:01.217 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:44:01.217 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:44:02.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:02.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:02.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:02.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:02.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:02.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:02.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:02.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.713+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:02.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:02.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:02.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:02.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:02.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:02.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:02.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:03.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:03.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:03.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:03.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:03.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:03.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:03.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:03.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:03.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:03.333+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:03.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:03.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:03.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:03.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:03.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:03.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:03.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:03.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:03.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:03.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:04.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:04.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:04.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:04.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:04.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:04.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:04.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:04.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:04.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:04.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:04.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:04.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:04.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:04.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:04.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:04.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:04.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:04.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:04.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:04.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:05.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:05.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.145+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:05.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:05.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:05.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:05.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:05.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:05.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:05.218 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:05.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:05.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:05.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:05.612 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:05.609+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:44:05.612 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:05.609+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:44:06.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:06.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:06.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:06.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:06.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:06.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:06.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:06.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:06.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:06.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:06.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:06.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.617+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:06.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:06.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:06.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:06.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:06.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:06.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:06.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:07.428 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:07.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:07.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:07.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:07.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:07.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:07.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:07.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:07.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:07.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:07.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:07.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:08.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:08.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:08.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:08.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:08.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:08.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:08.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:08.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:08.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:08.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:08.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:08.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:08.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:08.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:08.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:08.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:44:08.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:08.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:09.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:09.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:09.048 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:09.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:09.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:09.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:09.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.121+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:09.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:09.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:09.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:09.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:09.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:09.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:09.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:09.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:09.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:10.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:10.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:10.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:10.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:12.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:12.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:12.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:12.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:12.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:12.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:12.343 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:12.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:12.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:12.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:12.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:12.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:12.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:12.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:12.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:12.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:12.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.577+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:12.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:12.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:12.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:13.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:13.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.149+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:13.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:13.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.173+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:13.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:13.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:13.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:13.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:13.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:44:13.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:13.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:13.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:13.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.573+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:13.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:13.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:13.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:13.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:13.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:13.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:13.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:13.645+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:14.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:14.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:14.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:14.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:14.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:14.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:14.348 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:14.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:44:14.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:14.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:14.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:14.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:14.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:14.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:16.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:16.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:16.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:16.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:16.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:16.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:16.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.377+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:16.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.389+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:16.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:16.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:44:16.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.409+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:16.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:16.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:16.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:16.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:16.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:16.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:16.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:16.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:19.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:19.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:19.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:19.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:19.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:19.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:19.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:19.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:19.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:19.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:19.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:19.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:19.548 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:19.541+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:19.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:19.553+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:19.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:19.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:21.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:44:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:44:22.164 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:44:22.214 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2715,"stamp":"2023-09-23T08:44:20.634641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23664078155,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2468210,"num_read_kb":9718290,"num_write":2447767,"num_write_kb":9791439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80413,"ondisk_log_size":80413,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23994084,"kb_used_data":18251588,"kb_used_omap":1646,"kb_used_meta":5740817,"kb_avail":259121436,"statfs":{"total":289910292480,"available":265340350464,"internally_reserved":0,"allocated":18689626112,"data_stored":22674343973,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1685753,"internal_metadata":5878597383},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,4,6,13,7,23,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8654848,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4242,"num_read_kb":16956,"num_write":4191,"num_write_kb":16764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.011413"},"pg_stats":[{"pgid":"2.7","version":"88'304062","reported_seq":597200,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:18.718681+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:44:18.718681+0000","last_peered":"2023-09-23T08:44:18.718681+0000","last_clean":"2023-09-23T08:44:18.718681+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:44:18.718681+0000","last_undegraded":"2023-09-23T08:44:18.718681+0000","last_fullsized":"2023-09-23T08:44:18.718681+0000","mapping_epoch":13,"log_start":"88'294011","ondisk_log_start":"88'294011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2789290319,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":292030,"num_read_kb":1149898,"num_write":288538,"num_write_kb":1154056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'334774","reported_seq":658080,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:44:18.733880+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:44:18.733880+0000","last_peered":"2023-09-23T08:44:18.733880+0000","last_clean":"2023-09-23T08:44:18.733880+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:44:18.733880+0000","last_undegraded":"2023-09-23T08:44:18.733880+0000","last_fullsized":"2023-09-23T08:44:18.733880+0000","mapping_epoch":13,"log_start":"88'324708","ondisk_log_start":"88'324708","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":819,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 407s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3116077375,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":323038,"num_read_kb":1267910,"num_write":319556,"num_write_kb":1277993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'316860","reported_seq":621180,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:44:18.726352+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:44:18.726352+0000","last_peered":"2023-09-23T08:44:18.726352+0000","last_clean":"2023-09-23T08:44:18.726352+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:44:18.726352+0000","last_undegraded":"2023-09-23T08:44:18.726352+0000","last_fullsized":"2023-09-23T08:44:18.726352+0000","mapping_epoch":13,"log_start":"88'306810","ondisk_log_start":"88'306810","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":804,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 355s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2901025068,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":303252,"num_read_kb":1194041,"num_write":301621,"num_write_kb":1206397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'322476","reported_seq":644415,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:18.654200+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:44:18.654200+0000","last_peered":"2023-09-23T08:44:18.654200+0000","last_clean":"2023-09-23T08:44:18.654200+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:44:18.654200+0000","last_undegraded":"2023-09-23T08:44:18.654200+0000","last_fullsized":"2023-09-23T08:44:18.654200+0000","mapping_epoch":13,"log_start":"88'312412","ondisk_log_start":"88'312412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3104440602,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":322316,"num_read_kb":1275099,"num_write":320853,"num_write_kb":1283325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'314316","reported_seq":627138,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:19.056379+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:44:19.056379+0000","last_peered":"2023-09-23T08:44:19.056379+0000","last_clean":"2023-09-23T08:44:19.056379+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:44:19.056379+0000","last_undegraded":"2023-09-23T08:44:19.056379+0000","last_fullsized":"2023-09-23T08:44:19.056379+0000","mapping_epoch":13,"log_start":"88'304309","ondisk_log_start":"88'304309","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2996384062,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":312295,"num_read_kb":1229915,"num_write":310684,"num_write_kb":1242586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'324923","reported_seq":646048,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:18.730789+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:44:18.730789+0000","last_peered":"2023-09-23T08:44:18.730789+0000","last_clean":"2023-09-23T08:44:18.730789+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:44:18.730789+0000","last_undegraded":"2023-09-23T08:44:18.730789+0000","last_fullsized":"2023-09-23T08:44:18.730789+0000","mapping_epoch":13,"log_start":"88'314911","ondisk_log_start":"88'314911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3086459350,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":320038,"num_read_kb":1259492,"num_write":317619,"num_write_kb":1270356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'297330","reported_seq":591252,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:18.721018+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:44:18.721018+0000","last_peered":"2023-09-23T08:44:18.721018+0000","last_clean":"2023-09-23T08:44:18.721018+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:44:18.721018+0000","last_undegraded":"2023-09-23T08:44:18.721018+0000","last_fullsized":"2023-09-23T08:44:18.721018+0000","mapping_epoch":13,"log_start":"88'287308","ondisk_log_start":"88'287308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2798805293,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":292763,"num_read_kb":1152173,"num_write":290080,"num_write_kb":1160233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'314248","reported_seq":617648,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:18.628349+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:44:18.628349+0000","last_peered":"2023-09-23T08:44:18.628349+0000","last_clean":"2023-09-23T08:44:18.628349+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:44:18.628349+0000","last_undegraded":"2023-09-23T08:44:18.628349+0000","last_fullsized":"2023-09-23T08:44:18.628349+0000","mapping_epoch":13,"log_start":"88'304206","ondisk_log_start":"88'304206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2871005718,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":302372,"num_read_kb":1189671,"num_write":298679,"num_write_kb":1194599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":267,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:41.162521+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:40:41.162521+0000","last_peered":"2023-09-23T08:40:41.162521+0000","last_clean":"2023-09-23T08:40:41.162521+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:40:41.162521+0000","last_undegraded":"2023-09-23T08:40:41.162521+0000","last_fullsized":"2023-09-23T08:40:41.162521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23663487787,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2468104,"num_read_kb":9718199,"num_write":2447630,"num_write_kb":9789545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18688348160,"data_stored":22673102422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80314,"ondisk_log_size":80314,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739420,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5044240,"kb_used_data":3380296,"kb_used_omap":321,"kb_used_meta":1663614,"kb_avail":89327600,"statfs":{"total":96636764160,"available":91471462400,"internally_reserved":0,"allocated":3461423104,"data_stored":4191066526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":1703541340},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,5,1,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.184},"max":{"1min":7.6130000000000004,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.131,"5min":0.92800000000000005,"15min":0.74299999999999999},"min":{"1min":0.23899999999999999,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":7.492,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":1.1279999999999999,"15min":1.054},"min":{"1min":0.247,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":5.1859999999999999,"5min":10.759,"15min":10.759},"last":3.4540000000000002},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.518,"15min":1.2509999999999999},"min":{"1min":0.20999999999999999,"5min":0.184,"15min":0.184},"max":{"1min":5.7619999999999996,"5min":12.379,"15min":12.379},"last":4.1120000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739405,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11037488,"kb_used_data":9125348,"kb_used_omap":856,"kb_used_meta":1911271,"kb_avail":83334352,"statfs":{"total":96636764160,"available":85334376448,"internally_reserved":0,"allocated":9344356352,"data_stored":11336954320,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1957142394},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,0,2,8,6,15,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.45800000000000002,"15min":0.80600000000000005},"min":{"1min":0.214,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":1.0840000000000001,"5min":6.8689999999999998,"15min":21.216000000000001},"last":0.217},{"interface":"front","average":{"1min":0.81999999999999995,"5min":1.1819999999999999,"15min":1.262},"min":{"1min":0.245,"5min":0.189,"15min":0.17599999999999999},"max":{"1min":4.3369999999999997,"5min":9.2270000000000003,"15min":21.388999999999999},"last":0.191}]},{"osd":2,"last update":"Sat Sep 23 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65600000000000003,"15min":0.79500000000000004},"min":{"1min":0.251,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.8289999999999997,"5min":7.3600000000000003,"15min":10.798999999999999},"last":0.183},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.67400000000000004,"15min":0.80500000000000005},"min":{"1min":0.25700000000000001,"5min":0.254,"15min":0.23000000000000001},"max":{"1min":0.49299999999999999,"5min":7.4000000000000004,"15min":11.98},"last":0.29599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739415,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7912356,"kb_used_data":5745944,"kb_used_omap":468,"kb_used_meta":2165931,"kb_avail":86459484,"statfs":{"total":96636764160,"available":88534511616,"internally_reserved":0,"allocated":5883846656,"data_stored":7146323127,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":479951,"internal_metadata":2217913649},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.97299999999999998,"15min":1.131},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":2.4289999999999998,"5min":5.5679999999999996,"15min":17.216000000000001},"last":3.0489999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":1.1040000000000001,"15min":1.226},"min":{"1min":0.224,"5min":0.224,"15min":0.222},"max":{"1min":2.4649999999999999,"5min":14.000999999999999,"15min":17.251000000000001},"last":3.0830000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":0.95399999999999996,"15min":0.85099999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.193},"max":{"1min":6.1959999999999997,"5min":8.7699999999999996,"15min":12.529},"last":2.9449999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.184},"max":{"1min":5.7110000000000003,"5min":5.8310000000000004,"15min":12.388},"last":0.31}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5883260928,"data_stored":7145608722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9344077824,"data_stored":11336465195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3461009408,"data_stored":4191028505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:44:22.216 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:44:22.216 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:44:22.216 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:44:23.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:23.653+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:23.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:23.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:23.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:23.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:23.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:23.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:23.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:23.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:23.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:23.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:23.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:23.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:23.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:23.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:24.139 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:24.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:24.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:24.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:24.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:24.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:24.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:24.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:24.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:24.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:24.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:24.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:25.195 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:25.189+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:44:25.195 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:25.189+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:44:27.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:27.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.361+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:27.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:27.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:27.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:27.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:27.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.433+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:27.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:27.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:27.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:27.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:27.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:27.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:29.929 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:29.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:29.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:29.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:29.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:29.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:29.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:29.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:29.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:29.969+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:29.992 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:29.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:30.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:30.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:30.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:30.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:31.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:31.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:31.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:31.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:31.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:31.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:31.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:31.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:31.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:31.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:31.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:31.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:31.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:31.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:31.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:31.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:31.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:31.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:33.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:33.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:33.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:33.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:33.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:33.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:33.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:33.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.529+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:33.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:44:33.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.561+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:33.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:33.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.613+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:33.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:33.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:33.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:33.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:33.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:33.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:33.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:33.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:33.757+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:34.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:44:34.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:34.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:34.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:34.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:34.492 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:34.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:34.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:34.542 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.537+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:34.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:34.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:34.949 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:34.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:35.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.033+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:35.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.037+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:35.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:35.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.105+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:35.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:35.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:35.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:35.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:35.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:44:35.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:35.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:35.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:35.196 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:35.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.201+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:35.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:35.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:35.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:35.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:35.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:35.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:38.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:38.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:38.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:38.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:38.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:38.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:38.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:38.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:38.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:38.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:38.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:38.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:38.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:38.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:38.906 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:38.900+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:44:40.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:40.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:41.009 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:41.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:41.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:41.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:41.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:41.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:41.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:41.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:41.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:41.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:41.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:41.048+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:42.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:44:42.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:42.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:42.723 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:42.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:42.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:42.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:42.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:42.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:42.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:42.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:42.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:42.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:42.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:42.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:42.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:42.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:42.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:42.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:42.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:42.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:43.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:43.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:43.109 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:44:43.110 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:44:43.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:43.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:43.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:43.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:43.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:43.159 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.156+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:43.164 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2726,"stamp":"2023-09-23T08:44:42.638347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23680331083,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2475810,"num_read_kb":9748662,"num_write":2455445,"num_write_kb":9822151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80560,"ondisk_log_size":80560,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23013804,"kb_used_data":18287184,"kb_used_omap":1729,"kb_used_meta":4724862,"kb_avail":260101716,"statfs":{"total":289910292480,"available":266344157184,"internally_reserved":0,"allocated":18726076416,"data_stored":22705711141,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1770623,"internal_metadata":4838259585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,6,6,13,20,14,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8253440,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3952,"num_read_kb":15784,"num_write":3916,"num_write_kb":15664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001930"},"pg_stats":[{"pgid":"2.7","version":"88'305077","reported_seq":599137,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:39.614544+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:44:39.614544+0000","last_peered":"2023-09-23T08:44:39.614544+0000","last_clean":"2023-09-23T08:44:39.614544+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:44:39.614544+0000","last_undegraded":"2023-09-23T08:44:39.614544+0000","last_fullsized":"2023-09-23T08:44:39.614544+0000","mapping_epoch":13,"log_start":"88'295011","ondisk_log_start":"88'295011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2791395663,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":292941,"num_read_kb":1153542,"num_write":289514,"num_write_kb":1157960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'335849","reported_seq":660121,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:44:39.603156+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:44:39.603156+0000","last_peered":"2023-09-23T08:44:39.603156+0000","last_clean":"2023-09-23T08:44:39.603156+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:44:39.603156+0000","last_undegraded":"2023-09-23T08:44:39.603156+0000","last_fullsized":"2023-09-23T08:44:39.603156+0000","mapping_epoch":13,"log_start":"88'325808","ondisk_log_start":"88'325808","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":868,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 428s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3118231871,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":323987,"num_read_kb":1271702,"num_write":320558,"num_write_kb":1282001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'317889","reported_seq":623159,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:44:39.580169+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:44:39.580169+0000","last_peered":"2023-09-23T08:44:39.580169+0000","last_clean":"2023-09-23T08:44:39.580169+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:44:39.580169+0000","last_undegraded":"2023-09-23T08:44:39.580169+0000","last_fullsized":"2023-09-23T08:44:39.580169+0000","mapping_epoch":13,"log_start":"88'307811","ondisk_log_start":"88'307811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":854,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 376s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2903097644,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":304184,"num_read_kb":1197769,"num_write":302580,"num_write_kb":1210233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'323494","reported_seq":646483,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:39.511054+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:44:39.511054+0000","last_peered":"2023-09-23T08:44:39.511054+0000","last_clean":"2023-09-23T08:44:39.511054+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:44:39.511054+0000","last_undegraded":"2023-09-23T08:44:39.511054+0000","last_fullsized":"2023-09-23T08:44:39.511054+0000","mapping_epoch":13,"log_start":"88'313412","ondisk_log_start":"88'313412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3106570522,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":323366,"num_read_kb":1279295,"num_write":321871,"num_write_kb":1287397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'315213","reported_seq":629016,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:39.149588+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:44:39.149588+0000","last_peered":"2023-09-23T08:44:39.149588+0000","last_clean":"2023-09-23T08:44:39.149588+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:44:39.149588+0000","last_undegraded":"2023-09-23T08:44:39.149588+0000","last_fullsized":"2023-09-23T08:44:39.149588+0000","mapping_epoch":13,"log_start":"88'305209","ondisk_log_start":"88'305209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":2998325566,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":313267,"num_read_kb":1233795,"num_write":311577,"num_write_kb":1246158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'325875","reported_seq":647988,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:38.933881+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:44:38.933881+0000","last_peered":"2023-09-23T08:44:38.933881+0000","last_clean":"2023-09-23T08:44:38.933881+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:44:38.933881+0000","last_undegraded":"2023-09-23T08:44:38.933881+0000","last_fullsized":"2023-09-23T08:44:38.933881+0000","mapping_epoch":13,"log_start":"88'315811","ondisk_log_start":"88'315811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3088388566,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":321008,"num_read_kb":1263368,"num_write":318547,"num_write_kb":1274068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'298241","reported_seq":593062,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:38.903126+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:44:38.903126+0000","last_peered":"2023-09-23T08:44:38.903126+0000","last_clean":"2023-09-23T08:44:38.903126+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:44:38.903126+0000","last_undegraded":"2023-09-23T08:44:38.903126+0000","last_fullsized":"2023-09-23T08:44:38.903126+0000","mapping_epoch":13,"log_start":"88'288208","ondisk_log_start":"88'288208","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2800640301,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":293652,"num_read_kb":1155729,"num_write":290970,"num_write_kb":1163793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'315299","reported_seq":619639,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:39.506620+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:44:39.506620+0000","last_peered":"2023-09-23T08:44:39.506620+0000","last_clean":"2023-09-23T08:44:39.506620+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:44:39.506620+0000","last_undegraded":"2023-09-23T08:44:39.506620+0000","last_fullsized":"2023-09-23T08:44:39.506620+0000","mapping_epoch":13,"log_start":"88'305206","ondisk_log_start":"88'305206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2873090582,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":303299,"num_read_kb":1193371,"num_write":299691,"num_write_kb":1198647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":267,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:40:41.162521+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:40:41.162521+0000","last_peered":"2023-09-23T08:40:41.162521+0000","last_clean":"2023-09-23T08:40:41.162521+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:40:41.162521+0000","last_undegraded":"2023-09-23T08:40:41.162521+0000","last_fullsized":"2023-09-23T08:40:41.162521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23679740715,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2475704,"num_read_kb":9748571,"num_write":2455308,"num_write_kb":9820257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18725617664,"data_stored":22705247830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80461,"ondisk_log_size":80461,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739424,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088608,"kb_used_data":3386712,"kb_used_omap":321,"kb_used_meta":1701566,"kb_avail":89283232,"statfs":{"total":96636764160,"available":91426029568,"internally_reserved":0,"allocated":3467993088,"data_stored":4196665758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":1742404188},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,0,5,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.184},"max":{"1min":7.6130000000000004,"5min":7.7039999999999997,"15min":7.7039999999999997},"last":3.4300000000000002},{"interface":"front","average":{"1min":1.131,"5min":0.92800000000000005,"15min":0.74299999999999999},"min":{"1min":0.23899999999999999,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":7.492,"5min":14.997999999999999,"15min":14.997999999999999},"last":3.214}]},{"osd":1,"last update":"Sat Sep 23 08:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":1.1279999999999999,"15min":1.054},"min":{"1min":0.247,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":5.1859999999999999,"5min":10.759,"15min":10.759},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.518,"15min":1.2509999999999999},"min":{"1min":0.20999999999999999,"5min":0.184,"15min":0.184},"max":{"1min":5.7619999999999996,"5min":12.379,"15min":12.379},"last":0.29899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739409,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10818852,"kb_used_data":9143388,"kb_used_omap":856,"kb_used_meta":1674599,"kb_avail":83552988,"statfs":{"total":96636764160,"available":85558259712,"internally_reserved":0,"allocated":9362829312,"data_stored":11352850896,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1714790266},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3,10,11,9,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:44:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":0.67900000000000005,"15min":0.81999999999999995},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":7.343,"5min":7.343,"15min":21.216000000000001},"last":0.22},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.202,"15min":1.28},"min":{"1min":0.191,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":6.9039999999999999,"5min":9.2270000000000003,"15min":21.388999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:44:24 2023","interfaces":[{"interface":"back","average":{"1min":1.8300000000000001,"5min":0.93700000000000006,"15min":0.89000000000000001},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":7.4020000000000001,"5min":7.4020000000000001,"15min":10.798999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.9550000000000001,"5min":0.92200000000000004,"15min":0.88},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.23000000000000001},"max":{"1min":7.2370000000000001,"5min":7.4000000000000004,"15min":11.98},"last":0.26100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739419,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7106344,"kb_used_data":5757084,"kb_used_omap":551,"kb_used_meta":1348696,"kb_avail":87265496,"statfs":{"total":96636764160,"available":89359867904,"internally_reserved":0,"allocated":5895254016,"data_stored":7156194487,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1381065131},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3,3,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.1040000000000001,"15min":1.1899999999999999},"min":{"1min":0.26200000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":7.8689999999999998,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.7470000000000001,"5min":1.2350000000000001,"15min":1.284},"min":{"1min":0.30299999999999999,"5min":0.224,"15min":0.224},"max":{"1min":7.944,"5min":14.000999999999999,"15min":17.251000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Sep 23 08:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":0.95399999999999996,"15min":0.85099999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.193},"max":{"1min":6.1959999999999997,"5min":8.7699999999999996,"15min":12.529},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.184},"max":{"1min":5.7110000000000003,"5min":5.8310000000000004,"15min":12.388},"last":0.33500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5894864896,"data_stored":7155664402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9363087360,"data_stored":11352869675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3467665408,"data_stored":4196713753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:44:43.165 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:44:43.166 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:44:43.166 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:44:43.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:43.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:43.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:43.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:43.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:43.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:43.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:43.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:43.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:43.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:43.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:44.004 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:44.041 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:44.074 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:44.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:44.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:44.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:44.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:44.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:44.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:44.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:44.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:44.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:44.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:44.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:44.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:44.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:44.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:44.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:44.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:44.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:44.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:44.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:44.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:44.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:44.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:44.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:44.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:45.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:45.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:45.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:45.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:45.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:45.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:45.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:45.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:45.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:45.316+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:45.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:45.336+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:45.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:45.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:45.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:45.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:45.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:45.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:46.250 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:46.244+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:44:46.250 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:46.244+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:44:47.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:47.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:47.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:47.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:47.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:47.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:47.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:47.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:47.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:47.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:47.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:47.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:47.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:47.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:47.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:47.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:47.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:47.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:47.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:47.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:48.114 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:48.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:48.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:48.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:48.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:48.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:48.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:48.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:48.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:48.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:48.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:48.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:48.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:48.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:48.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:48.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:49.516 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:49.512+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:44:49.516 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:49.512+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:44:49.516 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:49.512+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:44:49.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:49.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:49.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:49.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:49.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:49.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:49.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:49.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:49.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:49.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:49.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:49.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:49.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:49.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:49.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:49.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:49.941 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:49.936+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:44:49.942 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:49.936+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:44:52.682 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.676+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:52.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:52.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:52.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:52.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:52.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:52.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:52.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:52.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:44:52.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:52.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:52.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:52.882 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:52.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:52.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:52.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:52.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:52.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:55.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:44:55.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:55.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:44:55.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:55.137 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:55.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:55.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:55.178 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:55.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:55.202 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:55.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:55.246 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:55.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:56.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:56.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:44:56.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:56.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:44:56.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:56.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:44:56.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:56.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:44:56.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:56.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:44:56.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:56.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:44:56.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:56.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:44:56.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:56.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:44:57.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:57.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:44:57.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:44:57.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:44:59.543 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:59.540+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:44:59.543 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:59.540+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:44:59.543 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:59.540+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:44:59.550 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:59.548+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:44:59.551 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:59.548+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:44:59.551 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:44:59.548+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:45:00.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:00.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:00.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:00.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:00.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:00.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:00.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:00.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:00.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:00.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:00.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:45:00.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:00.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:00.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:00.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:00.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:00.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:01.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:01.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:01.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:01.632+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:01.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:01.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:01.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:01.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:01.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:01.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:01.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:01.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:01.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:01.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:03.167 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:45:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:45:03.885 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:45:03.911 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2736,"stamp":"2023-09-23T08:45:02.644176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23696371019,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2483816,"num_read_kb":9780674,"num_write":2463174,"num_write_kb":9853067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80474,"ondisk_log_size":80474,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23284560,"kb_used_data":18324072,"kb_used_omap":1729,"kb_used_meta":4958718,"kb_avail":259830960,"statfs":{"total":289910292480,"available":266066903040,"internally_reserved":0,"allocated":18763849728,"data_stored":22738188325,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1770623,"internal_metadata":5077728129},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,5,11,13,20,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7962624,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3939,"num_read_kb":15752,"num_write":3878,"num_write_kb":15512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004543"},"pg_stats":[{"pgid":"2.7","version":"88'306075","reported_seq":601123,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:00.267358+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:45:00.267358+0000","last_peered":"2023-09-23T08:45:00.267358+0000","last_clean":"2023-09-23T08:45:00.267358+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:45:00.267358+0000","last_undegraded":"2023-09-23T08:45:00.267358+0000","last_fullsized":"2023-09-23T08:45:00.267358+0000","mapping_epoch":13,"log_start":"88'296011","ondisk_log_start":"88'296011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2793345359,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":293917,"num_read_kb":1157446,"num_write":290464,"num_write_kb":1161760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'336954","reported_seq":662317,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:45:00.201804+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:45:00.201804+0000","last_peered":"2023-09-23T08:45:00.201804+0000","last_clean":"2023-09-23T08:45:00.201804+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:45:00.201804+0000","last_undegraded":"2023-09-23T08:45:00.201804+0000","last_fullsized":"2023-09-23T08:45:00.201804+0000","mapping_epoch":13,"log_start":"88'326908","ondisk_log_start":"88'326908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":893,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 448s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3120509247,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":325057,"num_read_kb":1275982,"num_write":321602,"num_write_kb":1286177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'318915","reported_seq":625157,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:45:00.190450+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:45:00.190450+0000","last_peered":"2023-09-23T08:45:00.190450+0000","last_clean":"2023-09-23T08:45:00.190450+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:45:00.190450+0000","last_undegraded":"2023-09-23T08:45:00.190450+0000","last_fullsized":"2023-09-23T08:45:00.190450+0000","mapping_epoch":13,"log_start":"88'308911","ondisk_log_start":"88'308911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":893,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 397s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2905153836,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":305132,"num_read_kb":1201553,"num_write":303533,"num_write_kb":1214045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'324504","reported_seq":648569,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:00.174446+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:45:00.174446+0000","last_peered":"2023-09-23T08:45:00.174446+0000","last_clean":"2023-09-23T08:45:00.174446+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:45:00.174446+0000","last_undegraded":"2023-09-23T08:45:00.174446+0000","last_fullsized":"2023-09-23T08:45:00.174446+0000","mapping_epoch":13,"log_start":"88'314412","ondisk_log_start":"88'314412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3108581658,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":324442,"num_read_kb":1283599,"num_write":322881,"num_write_kb":1291437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'316221","reported_seq":631048,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:59.382230+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:44:59.382230+0000","last_peered":"2023-09-23T08:44:59.382230+0000","last_clean":"2023-09-23T08:44:59.382230+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:44:59.382230+0000","last_undegraded":"2023-09-23T08:44:59.382230+0000","last_fullsized":"2023-09-23T08:44:59.382230+0000","mapping_epoch":13,"log_start":"88'306209","ondisk_log_start":"88'306209","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3000394046,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":314284,"num_read_kb":1237863,"num_write":312581,"num_write_kb":1250174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'326858","reported_seq":650016,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:58.920716+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:44:58.920716+0000","last_peered":"2023-09-23T08:44:58.920716+0000","last_clean":"2023-09-23T08:44:58.920716+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:44:58.920716+0000","last_undegraded":"2023-09-23T08:44:58.920716+0000","last_fullsized":"2023-09-23T08:44:58.920716+0000","mapping_epoch":13,"log_start":"88'316811","ondisk_log_start":"88'316811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3090395606,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":322039,"num_read_kb":1267492,"num_write":319506,"num_write_kb":1277904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'299174","reported_seq":594915,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:58.966611+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:44:58.966611+0000","last_peered":"2023-09-23T08:44:58.966611+0000","last_clean":"2023-09-23T08:44:58.966611+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:44:58.966611+0000","last_undegraded":"2023-09-23T08:44:58.966611+0000","last_fullsized":"2023-09-23T08:44:58.966611+0000","mapping_epoch":13,"log_start":"88'289108","ondisk_log_start":"88'289108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2802463021,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":294557,"num_read_kb":1159349,"num_write":291876,"num_write_kb":1167417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'316250","reported_seq":621585,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:00.169591+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:45:00.169591+0000","last_peered":"2023-09-23T08:45:00.169591+0000","last_clean":"2023-09-23T08:45:00.169591+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:45:00.169591+0000","last_undegraded":"2023-09-23T08:45:00.169591+0000","last_fullsized":"2023-09-23T08:45:00.169591+0000","mapping_epoch":13,"log_start":"88'306206","ondisk_log_start":"88'306206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2874937878,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":304282,"num_read_kb":1197299,"num_write":300594,"num_write_kb":1202259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":268,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:45.336368+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:42:45.336368+0000","last_peered":"2023-09-23T08:42:45.336368+0000","last_clean":"2023-09-23T08:42:45.336368+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:42:45.336368+0000","last_undegraded":"2023-09-23T08:42:45.336368+0000","last_fullsized":"2023-09-23T08:42:45.336368+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23695780651,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2483710,"num_read_kb":9780583,"num_write":2463037,"num_write_kb":9851173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18762911744,"data_stored":22737323606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80375,"ondisk_log_size":80375,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739428,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5169216,"kb_used_data":3393268,"kb_used_omap":321,"kb_used_meta":1775614,"kb_avail":89202624,"statfs":{"total":96636764160,"available":91343486976,"internally_reserved":0,"allocated":3474706432,"data_stored":4202469790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":1818229340},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,1,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70499999999999996,"15min":0.82199999999999995},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.186},"max":{"1min":6.2140000000000004,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":4.008},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.92000000000000004,"15min":0.77500000000000002},"min":{"1min":0.249,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":6.2460000000000004,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.373}]},{"osd":1,"last update":"Sat Sep 23 08:44:39 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.1299999999999999,"15min":1.1080000000000001},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":6.4960000000000004,"5min":8.7210000000000001,"15min":10.759},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.401,"5min":1.4790000000000001,"15min":1.276},"min":{"1min":0.22800000000000001,"5min":0.20999999999999999,"15min":0.184},"max":{"1min":5.2359999999999998,"5min":10.766999999999999,"15min":12.379},"last":0.58199999999999996}]}]},{"osd":1,"up_from":8,"seq":34359739413,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10986208,"kb_used_data":9162192,"kb_used_omap":856,"kb_used_meta":1823143,"kb_avail":83385632,"statfs":{"total":96636764160,"available":85386887168,"internally_reserved":0,"allocated":9382084608,"data_stored":11369406928,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":1866899322},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,8,8,10,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:44:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":0.67900000000000005,"15min":0.81999999999999995},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":7.343,"5min":7.343,"15min":21.216000000000001},"last":0.254},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.202,"15min":1.28},"min":{"1min":0.191,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":6.9039999999999999,"5min":9.2270000000000003,"15min":21.388999999999999},"last":0.33900000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:44:24 2023","interfaces":[{"interface":"back","average":{"1min":1.8300000000000001,"5min":0.93700000000000006,"15min":0.89000000000000001},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":7.4020000000000001,"5min":7.4020000000000001,"15min":10.798999999999999},"last":0.31},{"interface":"front","average":{"1min":1.9550000000000001,"5min":0.92200000000000004,"15min":0.88},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.23000000000000001},"max":{"1min":7.2370000000000001,"5min":7.4000000000000004,"15min":11.98},"last":0.38100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739423,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7129136,"kb_used_data":5768612,"kb_used_omap":551,"kb_used_meta":1359960,"kb_avail":87242704,"statfs":{"total":96636764160,"available":89336528896,"internally_reserved":0,"allocated":5907058688,"data_stored":7166311607,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1392599467},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,3,2,4,6,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.1040000000000001,"15min":1.1899999999999999},"min":{"1min":0.26200000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":7.8689999999999998,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.188},{"interface":"front","average":{"1min":1.7470000000000001,"5min":1.2350000000000001,"15min":1.284},"min":{"1min":0.30299999999999999,"5min":0.224,"15min":0.224},"max":{"1min":7.944,"5min":14.000999999999999,"15min":17.251000000000001},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":0.95399999999999996,"15min":0.85099999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.193},"max":{"1min":6.1959999999999997,"5min":8.7699999999999996,"15min":12.529},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.184},"max":{"1min":5.7110000000000003,"5min":5.8310000000000004,"15min":12.388},"last":0.32300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5906796544,"data_stored":7165892114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9381900288,"data_stored":11369048875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3474214912,"data_stored":4202382617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:45:03.913 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:45:03.913 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:45:03.914 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-09-23T08:45:04.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:04.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:04.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:04.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:04.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:04.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:04.523 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-09-23T08:45:04.554 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-09-23T08:45:04.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:04.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:04.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:04.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:04.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:04.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:04.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:04.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:05.220 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-09-23T08:45:05.277 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:45:06.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:06.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:06.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:06.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:06.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:06.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:06.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:06.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:06.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:06.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:06.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:06.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:06.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:08.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:45:08.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:45:08.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:08.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:08.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:08.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:08.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:08.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:08.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:08.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:08.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:08.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:08.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:08.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:08.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:08.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:08.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.236+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:08.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:08.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:08.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:08.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:08.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:09.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:09.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:09.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:09.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:09.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:09.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:09.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:09.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:09.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:09.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:09.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:09.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:09.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:09.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:10.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:10.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:10.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:10.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:10.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:10.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:10.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:10.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:10.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:10.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.416+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:10.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.476+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:10.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:10.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:10.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.492+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:10.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:10.539 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:10.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:10.809 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:10.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:10.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:10.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:10.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:10.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:10.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:10.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:10.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:11.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:11.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:11.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:11.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:11.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:11.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:11.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:11.896+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:11.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:11.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:11.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:11.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:11.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:11.940+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:11.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:11.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:11.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:11.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:11.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:11.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:13.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:13.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:13.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:13.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:13.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:13.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:13.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:13.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:13.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:13.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:13.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:13.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:14.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:14.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:14.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:14.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:14.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:14.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:14.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:14.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:14.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:14.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:14.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:14.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:14.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:14.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:15.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:15.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:15.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.508+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:15.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:15.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:15.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:15.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:45:15.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:45:15.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:15.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:15.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:15.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:15.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:15.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:15.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:15.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:15.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:15.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:15.904+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:18.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:18.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:45:18.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:18.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:18.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:18.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:18.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:18.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:18.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:18.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:18.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:18.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:18.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:18.240+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:18.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:18.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:18.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:18.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:18.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:18.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:20.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:20.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:20.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:20.300+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:20.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:20.332+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:20.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:20.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:20.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:20.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:20.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:20.368+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:20.429 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:20.424+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:20.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:20.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:20.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:20.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:20.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:20.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:22.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:22.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:22.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:22.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:22.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:22.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:22.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:22.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:22.762 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:22.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:22.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:22.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:22.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:22.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:22.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:22.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:22.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:22.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:22.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:22.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:23.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:45:23.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:23.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:23.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:23.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:23.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.592+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:23.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:23.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:23.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:23.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:23.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:23.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:24.547 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:24.540+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:45:25.279 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:45:25.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:25.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:45:25.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:25.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:25.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:25.504+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:25.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:25.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:25.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:25.520+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:25.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:25.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:25.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:25.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:25.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:25.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:25.571 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:25.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:26.072 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:45:26.073 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:45:26.108 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2747,"stamp":"2023-09-23T08:45:24.654315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23713910091,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2492447,"num_read_kb":9815186,"num_write":2471677,"num_write_kb":9887079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80514,"ondisk_log_size":80514,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23664148,"kb_used_data":18365292,"kb_used_omap":1729,"kb_used_meta":5297086,"kb_avail":259451372,"statfs":{"total":289910292480,"available":265678204928,"internally_reserved":0,"allocated":18806059008,"data_stored":22774192165,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1770623,"internal_metadata":5424216961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,5,0,3,4,11,7,11,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9420800,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4672,"num_read_kb":18676,"num_write":4615,"num_write_kb":18460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001987"},"pg_stats":[{"pgid":"2.7","version":"88'307001","reported_seq":603032,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:20.955156+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:45:20.955156+0000","last_peered":"2023-09-23T08:45:20.955156+0000","last_clean":"2023-09-23T08:45:20.955156+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:45:20.955156+0000","last_undegraded":"2023-09-23T08:45:20.955156+0000","last_fullsized":"2023-09-23T08:45:20.955156+0000","mapping_epoch":13,"log_start":"88'296911","ondisk_log_start":"88'296911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2795037007,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":294886,"num_read_kb":1161322,"num_write":291329,"num_write_kb":1165220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'338021","reported_seq":664459,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:45:20.984971+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:45:20.984971+0000","last_peered":"2023-09-23T08:45:20.984971+0000","last_clean":"2023-09-23T08:45:20.984971+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:45:20.984971+0000","last_undegraded":"2023-09-23T08:45:20.984971+0000","last_fullsized":"2023-09-23T08:45:20.984971+0000","mapping_epoch":13,"log_start":"88'328008","ondisk_log_start":"88'328008","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":921,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 469s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3122659647,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":326110,"num_read_kb":1280194,"num_write":322595,"num_write_kb":1290149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'319984","reported_seq":627229,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:45:20.941052+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:45:20.941052+0000","last_peered":"2023-09-23T08:45:20.941052+0000","last_clean":"2023-09-23T08:45:20.941052+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:45:20.941052+0000","last_undegraded":"2023-09-23T08:45:20.941052+0000","last_fullsized":"2023-09-23T08:45:20.941052+0000","mapping_epoch":13,"log_start":"88'309911","ondisk_log_start":"88'309911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":936,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 418s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2907144492,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":306113,"num_read_kb":1205473,"num_write":304515,"num_write_kb":1217973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'325516","reported_seq":650670,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:20.939251+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:45:20.939251+0000","last_peered":"2023-09-23T08:45:20.939251+0000","last_clean":"2023-09-23T08:45:20.939251+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:45:20.939251+0000","last_undegraded":"2023-09-23T08:45:20.939251+0000","last_fullsized":"2023-09-23T08:45:20.939251+0000","mapping_epoch":13,"log_start":"88'315512","ondisk_log_start":"88'315512","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3110846746,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":325533,"num_read_kb":1287959,"num_write":323893,"num_write_kb":1295485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'317474","reported_seq":633514,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:24.628543+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:45:24.628543+0000","last_peered":"2023-09-23T08:45:24.628543+0000","last_clean":"2023-09-23T08:45:24.628543+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:45:24.628543+0000","last_undegraded":"2023-09-23T08:45:24.628543+0000","last_fullsized":"2023-09-23T08:45:24.628543+0000","mapping_epoch":13,"log_start":"88'307409","ondisk_log_start":"88'307409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3002958142,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":315487,"num_read_kb":1242675,"num_write":313834,"num_write_kb":1255186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'328173","reported_seq":652597,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:24.209220+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:45:24.209220+0000","last_peered":"2023-09-23T08:45:24.209220+0000","last_clean":"2023-09-23T08:45:24.209220+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:45:24.209220+0000","last_undegraded":"2023-09-23T08:45:24.209220+0000","last_fullsized":"2023-09-23T08:45:24.209220+0000","mapping_epoch":13,"log_start":"88'318111","ondisk_log_start":"88'318111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3093082582,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":323291,"num_read_kb":1272500,"num_write":320794,"num_write_kb":1283056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'300375","reported_seq":597235,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:24.189150+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:45:24.189150+0000","last_peered":"2023-09-23T08:45:24.189150+0000","last_clean":"2023-09-23T08:45:24.189150+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:45:24.189150+0000","last_undegraded":"2023-09-23T08:45:24.189150+0000","last_fullsized":"2023-09-23T08:45:24.189150+0000","mapping_epoch":13,"log_start":"88'290308","ondisk_log_start":"88'290308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2804793645,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":295666,"num_read_kb":1163781,"num_write":293050,"num_write_kb":1172113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'317247","reported_seq":623566,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:20.931047+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:45:20.931047+0000","last_peered":"2023-09-23T08:45:20.931047+0000","last_clean":"2023-09-23T08:45:20.931047+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:45:20.931047+0000","last_undegraded":"2023-09-23T08:45:20.931047+0000","last_fullsized":"2023-09-23T08:45:20.931047+0000","mapping_epoch":13,"log_start":"88'307206","ondisk_log_start":"88'307206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2876797462,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":305255,"num_read_kb":1201191,"num_write":301530,"num_write_kb":1206003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":268,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:45.336368+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:42:45.336368+0000","last_peered":"2023-09-23T08:42:45.336368+0000","last_clean":"2023-09-23T08:42:45.336368+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:42:45.336368+0000","last_undegraded":"2023-09-23T08:42:45.336368+0000","last_fullsized":"2023-09-23T08:42:45.336368+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23713319723,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2492341,"num_read_kb":9815095,"num_write":2471540,"num_write_kb":9885185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18804666368,"data_stored":22772909654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80415,"ondisk_log_size":80415,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739433,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5213684,"kb_used_data":3401644,"kb_used_omap":321,"kb_used_meta":1811710,"kb_avail":89158156,"statfs":{"total":96636764160,"available":91297951744,"internally_reserved":0,"allocated":3483283456,"data_stored":4209838494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":1855191644},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.70499999999999996,"15min":0.82199999999999995},"min":{"1min":0.21199999999999999,"5min":0.20599999999999999,"15min":0.186},"max":{"1min":6.2140000000000004,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":0.28999999999999998},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.92000000000000004,"15min":0.77500000000000002},"min":{"1min":0.249,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":6.2460000000000004,"5min":14.997999999999999,"15min":14.997999999999999},"last":0.36499999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:44:39 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.1299999999999999,"15min":1.1080000000000001},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":6.4960000000000004,"5min":8.7210000000000001,"15min":10.759},"last":0.32800000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.4790000000000001,"15min":1.276},"min":{"1min":0.22800000000000001,"5min":0.20999999999999999,"15min":0.184},"max":{"1min":5.2359999999999998,"5min":10.766999999999999,"15min":12.379},"last":0.46700000000000003}]}]},{"osd":1,"up_from":8,"seq":34359739417,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11225464,"kb_used_data":9181088,"kb_used_omap":856,"kb_used_meta":2043495,"kb_avail":83146376,"statfs":{"total":96636764160,"available":85141889024,"internally_reserved":0,"allocated":9401434112,"data_stored":11385917904,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":876678,"internal_metadata":2092539770},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,5,0,1,3,7,5,8,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:44:24 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":0.67900000000000005,"15min":0.81999999999999995},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":7.343,"5min":7.343,"15min":21.216000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.202,"15min":1.28},"min":{"1min":0.191,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":6.9039999999999999,"5min":9.2270000000000003,"15min":21.388999999999999},"last":1.2509999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:44:24 2023","interfaces":[{"interface":"back","average":{"1min":1.8300000000000001,"5min":0.93700000000000006,"15min":0.89000000000000001},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":7.4020000000000001,"5min":7.4020000000000001,"15min":10.798999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":1.9550000000000001,"5min":0.92200000000000004,"15min":0.88},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.23000000000000001},"max":{"1min":7.2370000000000001,"5min":7.4000000000000004,"15min":11.98},"last":0.35499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739428,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7225000,"kb_used_data":5782560,"kb_used_omap":551,"kb_used_meta":1441880,"kb_avail":87146840,"statfs":{"total":96636764160,"available":89238364160,"internally_reserved":0,"allocated":5921341440,"data_stored":7178435767,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1476485547},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,4,2,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:44:37 2023","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.1040000000000001,"15min":1.1899999999999999},"min":{"1min":0.26200000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":7.8689999999999998,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.311},{"interface":"front","average":{"1min":1.7470000000000001,"5min":1.2350000000000001,"15min":1.284},"min":{"1min":0.30299999999999999,"5min":0.224,"15min":0.224},"max":{"1min":7.944,"5min":14.000999999999999,"15min":17.251000000000001},"last":0.376}]},{"osd":2,"last update":"Sat Sep 23 08:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.82599999999999996,"15min":0.79600000000000004},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.193},"max":{"1min":3.532,"5min":6.1959999999999997,"15min":8.7699999999999996},"last":2.9369999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.68200000000000005,"15min":0.61099999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.184},"max":{"1min":4.0190000000000001,"5min":5.8310000000000004,"15min":7.0410000000000004},"last":0.34699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5921132544,"data_stored":7178049042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9400791040,"data_stored":11385154347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3482742784,"data_stored":4209706265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:45:26.110 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:45:26.110 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:45:26.110 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:45:26.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:26.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:26.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:26.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:26.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:26.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:26.656 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:26.652+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:45:26.656 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:26.652+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:45:26.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:26.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:26.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:26.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:26.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:26.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:26.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:26.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:26.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:26.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:26.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:26.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:26.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:26.764+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:28.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:28.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:28.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:28.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:28.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:28.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:28.855 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:28.852+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:28.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:28.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:28.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:28.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:28.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:28.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:28.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:28.900+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:28.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:28.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:31.322 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:31.316+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:45:31.323 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:31.316+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:45:31.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:31.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:31.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:31.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:31.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:31.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:31.770 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:31.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:31.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:31.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:31.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:31.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:31.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:31.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:31.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:31.868+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:31.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:31.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:32.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:32.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:32.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:32.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:32.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:32.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:32.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:32.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.096+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:32.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:32.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.484+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:32.500 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.496+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:32.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:32.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:32.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:32.604 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.600+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:32.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:32.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:32.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:35.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:35.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:35.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:35.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:35.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:35.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:35.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:35.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:35.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:35.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:35.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:35.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:35.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:35.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:35.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:35.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:35.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:35.312+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:36.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:36.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:36.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:36.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:36.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:36.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:36.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:36.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:36.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:36.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:36.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:36.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:36.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:36.500+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:36.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:36.576+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:36.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:36.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:36.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:36.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:36.867 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:45:36.864+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:45:36.867 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:45:36.864+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:45:39.028 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:39.024+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:45:39.029 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:39.024+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:45:39.918 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:39.912+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:45:39.918 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:39.912+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:45:40.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:40.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:40.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:40.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:40.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:40.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:40.927 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.920+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:45:40.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:45:40.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:40.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.944+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:40.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:40.977 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:40.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:41.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:41.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:41.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:41.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:41.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:41.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:43.052 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:43.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:43.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.072+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:43.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:43.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:43.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:43.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:43.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:43.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:43.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.799+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:43.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:43.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:43.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:43.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.939+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:43.952 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:43.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:44.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:44.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:43.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:46.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:45.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:46.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:45.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:46.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:46.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:46.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:46.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:46.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:46.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:46.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:46.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:46.111 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:45:46.883 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:45:46.884 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:45:46.935 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2758,"stamp":"2023-09-23T08:45:46.657939+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23730261323,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2500189,"num_read_kb":9846138,"num_write":2479516,"num_write_kb":9918435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80521,"ondisk_log_size":80521,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22760564,"kb_used_data":18401812,"kb_used_omap":1772,"kb_used_meta":4356947,"kb_avail":260354956,"statfs":{"total":289910292480,"available":266603474944,"internally_reserved":0,"allocated":18843455488,"data_stored":22805637157,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1814810,"internal_metadata":4461514470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,4,9,6,12,6,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8683520,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4161,"num_read_kb":16640,"num_write":4213,"num_write_kb":16852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001960"},"pg_stats":[{"pgid":"2.7","version":"88'307943","reported_seq":604974,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:41.628416+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:45:41.628416+0000","last_peered":"2023-09-23T08:45:41.628416+0000","last_clean":"2023-09-23T08:45:41.628416+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:45:41.628416+0000","last_undegraded":"2023-09-23T08:45:41.628416+0000","last_fullsized":"2023-09-23T08:45:41.628416+0000","mapping_epoch":13,"log_start":"88'297911","ondisk_log_start":"88'297911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2796880207,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":295874,"num_read_kb":1165274,"num_write":292234,"num_write_kb":1168840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'339081","reported_seq":666575,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:45:41.627395+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:45:41.627395+0000","last_peered":"2023-09-23T08:45:41.627395+0000","last_clean":"2023-09-23T08:45:41.627395+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:45:41.627395+0000","last_undegraded":"2023-09-23T08:45:41.627395+0000","last_fullsized":"2023-09-23T08:45:41.627395+0000","mapping_epoch":13,"log_start":"88'329008","ondisk_log_start":"88'329008","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":955,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 490s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3124838719,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":327146,"num_read_kb":1284338,"num_write":323599,"num_write_kb":1294165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'321042","reported_seq":629259,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:45:41.578024+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:45:41.578024+0000","last_peered":"2023-09-23T08:45:41.578024+0000","last_clean":"2023-09-23T08:45:41.578024+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:45:41.578024+0000","last_undegraded":"2023-09-23T08:45:41.578024+0000","last_fullsized":"2023-09-23T08:45:41.578024+0000","mapping_epoch":13,"log_start":"88'311011","ondisk_log_start":"88'311011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":971,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 438s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2909266220,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":307071,"num_read_kb":1209301,"num_write":305518,"num_write_kb":1221985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'326531","reported_seq":652695,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:41.609410+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:45:41.609410+0000","last_peered":"2023-09-23T08:45:41.609410+0000","last_clean":"2023-09-23T08:45:41.609410+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:45:41.609410+0000","last_undegraded":"2023-09-23T08:45:41.609410+0000","last_fullsized":"2023-09-23T08:45:41.609410+0000","mapping_epoch":13,"log_start":"88'316512","ondisk_log_start":"88'316512","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3113001242,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":326540,"num_read_kb":1291983,"num_write":324908,"num_write_kb":1299545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'318506","reported_seq":635499,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:44.762919+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:45:44.762919+0000","last_peered":"2023-09-23T08:45:44.762919+0000","last_clean":"2023-09-23T08:45:44.762919+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:45:44.762919+0000","last_undegraded":"2023-09-23T08:45:44.762919+0000","last_fullsized":"2023-09-23T08:45:44.762919+0000","mapping_epoch":13,"log_start":"88'308409","ondisk_log_start":"88'308409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3005071678,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":316433,"num_read_kb":1246459,"num_write":314856,"num_write_kb":1259274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'329175","reported_seq":654628,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:44.300123+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:45:44.300123+0000","last_peered":"2023-09-23T08:45:44.300123+0000","last_clean":"2023-09-23T08:45:44.300123+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:45:44.300123+0000","last_undegraded":"2023-09-23T08:45:44.300123+0000","last_fullsized":"2023-09-23T08:45:44.300123+0000","mapping_epoch":13,"log_start":"88'319111","ondisk_log_start":"88'319111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3095118294,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":324313,"num_read_kb":1276584,"num_write":321760,"num_write_kb":1286920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'301350","reported_seq":599106,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:44.276109+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:45:44.276109+0000","last_peered":"2023-09-23T08:45:44.276109+0000","last_clean":"2023-09-23T08:45:44.276109+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:45:44.276109+0000","last_undegraded":"2023-09-23T08:45:44.276109+0000","last_fullsized":"2023-09-23T08:45:44.276109+0000","mapping_epoch":13,"log_start":"88'291308","ondisk_log_start":"88'291308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2806739245,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":296545,"num_read_kb":1167297,"num_write":293989,"num_write_kb":1175869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'318270","reported_seq":625508,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:45:41.568974+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:45:41.568974+0000","last_peered":"2023-09-23T08:45:41.568974+0000","last_clean":"2023-09-23T08:45:41.568974+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:45:41.568974+0000","last_undegraded":"2023-09-23T08:45:41.568974+0000","last_fullsized":"2023-09-23T08:45:41.568974+0000","mapping_epoch":13,"log_start":"88'308206","ondisk_log_start":"88'308206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2878755350,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":306161,"num_read_kb":1204811,"num_write":302515,"num_write_kb":1209943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":268,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:45.336368+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:42:45.336368+0000","last_peered":"2023-09-23T08:42:45.336368+0000","last_clean":"2023-09-23T08:42:45.336368+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:42:45.336368+0000","last_undegraded":"2023-09-23T08:42:45.336368+0000","last_fullsized":"2023-09-23T08:42:45.336368+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23729670955,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2500083,"num_read_kb":9846047,"num_write":2479379,"num_write_kb":9916541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18842431488,"data_stored":22804637270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80422,"ondisk_log_size":80422,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739437,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5282740,"kb_used_data":3408236,"kb_used_omap":321,"kb_used_meta":1874174,"kb_avail":89089100,"statfs":{"total":96636764160,"available":91227238400,"internally_reserved":0,"allocated":3490033664,"data_stored":4215593374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":1919154780},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.79300000000000004,"15min":0.84799999999999998},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":5.3979999999999997,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":5.4329999999999998,"5min":7.492,"15min":14.997999999999999},"last":0.33000000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:45:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.135,"15min":1.1319999999999999},"min":{"1min":0.26500000000000001,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":5.9610000000000003,"5min":8.7210000000000001,"15min":10.759},"last":0.314},{"interface":"front","average":{"1min":1.298,"5min":1.3220000000000001,"15min":1.3180000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":6.1799999999999997,"5min":10.766999999999999,"15min":12.379},"last":0.45100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739421,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10146380,"kb_used_data":9198972,"kb_used_omap":899,"kb_used_meta":946492,"kb_avail":84225460,"statfs":{"total":96636764160,"available":86246871040,"internally_reserved":0,"allocated":9419747328,"data_stored":11401290192,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":969208543},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,8,4,10,6,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.73099999999999998,"15min":0.76600000000000001},"min":{"1min":0.22,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":10.898,"5min":10.898,"15min":11.917},"last":0.45100000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.0900000000000001,"15min":1.2030000000000001},"min":{"1min":0.19600000000000001,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":15.718},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Sep 23 08:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.0669999999999999,"15min":0.90400000000000003},"min":{"1min":0.248,"5min":0.183,"15min":0.183},"max":{"1min":7.2830000000000004,"5min":7.4020000000000001,"15min":10.798999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.84799999999999998,"15min":0.79100000000000004},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.23000000000000001},"max":{"1min":2.1819999999999999,"5min":7.4000000000000004,"15min":7.8170000000000002},"last":0.60999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739432,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7331444,"kb_used_data":5794604,"kb_used_omap":551,"kb_used_meta":1536280,"kb_avail":87040396,"statfs":{"total":96636764160,"available":89129365504,"internally_reserved":0,"allocated":5933674496,"data_stored":7188753591,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1573151147},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,1,2,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.0149999999999999,"15min":1.169},"min":{"1min":0.188,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":5.5129999999999999,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.0600000000000001,"15min":1.2629999999999999},"min":{"1min":0.27000000000000002,"5min":0.224,"15min":0.224},"max":{"1min":5.548,"5min":7.944,"15min":17.251000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.82599999999999996,"15min":0.79600000000000004},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.193},"max":{"1min":3.532,"5min":6.1959999999999997,"15min":8.7699999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.68200000000000005,"15min":0.61099999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.184},"max":{"1min":4.0190000000000001,"5min":5.8310000000000004,"15min":7.0410000000000004},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5932965888,"data_stored":7187928594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9419853824,"data_stored":11401145131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3489611776,"data_stored":4215563545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:45:46.937 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:45:46.937 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:45:46.937 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:45:47.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:47.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:47.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:47.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:47.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:47.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:47.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:47.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:47.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:45:47.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:47.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:47.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.579+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:47.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:47.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:47.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:47.790 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:45:47.779+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:45:47.790 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:45:47.779+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:45:48.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:48.023+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:48.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:48.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:48.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:48.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:48.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:48.083+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:48.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:48.087+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:48.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:48.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:48.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:48.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:48.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:48.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:48.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:48.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:48.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:48.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:50.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:49.995+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:45:50.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:50.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.095+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:50.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:50.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:50.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:50.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.267+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:50.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:50.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:50.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:45:50.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:45:50.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:50.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:50.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:50.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.419+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:50.430 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:50.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:50.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:50.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:45:50.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:50.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:50.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:50.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:50.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:50.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:50.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:50.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:50.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:51.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:45:51.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:51.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:51.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.687+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:51.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:51.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:51.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:51.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:51.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:51.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.743+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:51.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:51.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:52.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.423+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:52.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.427+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:52.439 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:52.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.443+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:52.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:52.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:52.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:52.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:52.613 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:52.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:52.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:52.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:53.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:53.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:53.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.127+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:53.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:53.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:53.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.211+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:53.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:53.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:53.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:53.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.495+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:53.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:53.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:53.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:53.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:53.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:53.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:53.587+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:54.715 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:54.711+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:45:54.716 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:45:54.711+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:45:54.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:54.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:54.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:54.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:54.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:54.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:54.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:54.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:54.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:54.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:54.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:54.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:54.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:54.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:57.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.571+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:45:57.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:57.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:57.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:57.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:57.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:57.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.691+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:57.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:57.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.711+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:45:57.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.747+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:57.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:57.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:57.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:45:57.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.835+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:57.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:57.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:57.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:58.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.331+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:45:58.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:58.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:58.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:58.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:58.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.403+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:58.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:58.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:45:58.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:45:58.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:45:58.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:45:58.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:45:58.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:45:58.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:45:58.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:45:58.647+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:00.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:00.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:00.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:00.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.515+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:00.537 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:00.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:00.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:00.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:00.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.567+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:00.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:00.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:00.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:00.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:00.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:00.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:01.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:01.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.015+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:01.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:01.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:01.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:01.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:01.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:01.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:01.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:01.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:01.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:01.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:01.108 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:01.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:01.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:01.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:01.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:01.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.107+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:01.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:01.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:01.665 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.659+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:01.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:01.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:01.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:01.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:03.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:03.671+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:03.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:03.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:03.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:03.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:03.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:03.763+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:03.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:03.779+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:03.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:03.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:03.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:03.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:04.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:03.987+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:04.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:04.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:04.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:04.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:04.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:04.039+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:04.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:04.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:04.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:04.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:04.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:04.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:04.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:04.059+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:04.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:04.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:04.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:04.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:06.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:06.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:06.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:06.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.499+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:06.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:06.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:06.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:06.580 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.575+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:06.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:06.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:06.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:06.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.847+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:06.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:06.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.867+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:06.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:06.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:06.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:06.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:06.938 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:46:07.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.371+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:07.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:07.379 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:07.422 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:07.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:07.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:07.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:07.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:07.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:07.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:07.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.607+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:07.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:07.623+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:07.645 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:46:07.647 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:46:07.745 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2768,"stamp":"2023-09-23T08:46:06.665100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23745678667,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2507684,"num_read_kb":9876098,"num_write":2487168,"num_write_kb":9949043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80510,"ondisk_log_size":80510,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23015728,"kb_used_data":18437456,"kb_used_omap":1772,"kb_used_meta":4576467,"kb_avail":260099792,"statfs":{"total":289910292480,"available":266342187008,"internally_reserved":0,"allocated":18879954944,"data_stored":22836414501,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1814810,"internal_metadata":4686302950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,2,9,17,15,8,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8024064,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3875,"num_read_kb":15488,"num_write":3991,"num_write_kb":15964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001808"},"pg_stats":[{"pgid":"2.7","version":"88'308945","reported_seq":606891,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:02.176674+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:46:02.176674+0000","last_peered":"2023-09-23T08:46:02.176674+0000","last_clean":"2023-09-23T08:46:02.176674+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:46:02.176674+0000","last_undegraded":"2023-09-23T08:46:02.176674+0000","last_fullsized":"2023-09-23T08:46:02.176674+0000","mapping_epoch":13,"log_start":"88'298911","ondisk_log_start":"88'298911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2798768463,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":296781,"num_read_kb":1168898,"num_write":293169,"num_write_kb":1172580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'340193","reported_seq":668724,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:46:02.147527+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:46:02.147527+0000","last_peered":"2023-09-23T08:46:02.147527+0000","last_clean":"2023-09-23T08:46:02.147527+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:46:02.147527+0000","last_undegraded":"2023-09-23T08:46:02.147527+0000","last_fullsized":"2023-09-23T08:46:02.147527+0000","mapping_epoch":13,"log_start":"88'330108","ondisk_log_start":"88'330108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":983,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 510s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3126919487,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":328163,"num_read_kb":1288394,"num_write":324633,"num_write_kb":1298301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'322082","reported_seq":631259,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:46:02.109297+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:46:02.109297+0000","last_peered":"2023-09-23T08:46:02.109297+0000","last_clean":"2023-09-23T08:46:02.109297+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:46:02.109297+0000","last_undegraded":"2023-09-23T08:46:02.109297+0000","last_fullsized":"2023-09-23T08:46:02.109297+0000","mapping_epoch":13,"log_start":"88'312011","ondisk_log_start":"88'312011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1007,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 459s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2911113516,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":308005,"num_read_kb":1213033,"num_write":306470,"num_write_kb":1225793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'327575","reported_seq":654713,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:02.143721+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:46:02.143721+0000","last_peered":"2023-09-23T08:46:02.143721+0000","last_clean":"2023-09-23T08:46:02.143721+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:46:02.143721+0000","last_undegraded":"2023-09-23T08:46:02.143721+0000","last_fullsized":"2023-09-23T08:46:02.143721+0000","mapping_epoch":13,"log_start":"88'317512","ondisk_log_start":"88'317512","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3115028762,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":327515,"num_read_kb":1295883,"num_write":325952,"num_write_kb":1303721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'319448","reported_seq":637330,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:04.886933+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:46:04.886933+0000","last_peered":"2023-09-23T08:46:04.886933+0000","last_clean":"2023-09-23T08:46:04.886933+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:46:04.886933+0000","last_undegraded":"2023-09-23T08:46:04.886933+0000","last_fullsized":"2023-09-23T08:46:04.886933+0000","mapping_epoch":13,"log_start":"88'309409","ondisk_log_start":"88'309409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3006951742,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":317314,"num_read_kb":1249983,"num_write":315788,"num_write_kb":1263002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'330148","reported_seq":656573,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:04.442774+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:46:04.442774+0000","last_peered":"2023-09-23T08:46:04.442774+0000","last_clean":"2023-09-23T08:46:04.442774+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:46:04.442774+0000","last_undegraded":"2023-09-23T08:46:04.442774+0000","last_fullsized":"2023-09-23T08:46:04.442774+0000","mapping_epoch":13,"log_start":"88'320111","ondisk_log_start":"88'320111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3097047510,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":325268,"num_read_kb":1280404,"num_write":322721,"num_write_kb":1290764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'302233","reported_seq":600854,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:04.453378+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:46:04.453378+0000","last_peered":"2023-09-23T08:46:04.453378+0000","last_clean":"2023-09-23T08:46:04.453378+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:46:04.453378+0000","last_undegraded":"2023-09-23T08:46:04.453378+0000","last_fullsized":"2023-09-23T08:46:04.453378+0000","mapping_epoch":13,"log_start":"88'292208","ondisk_log_start":"88'292208","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2808594733,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":297398,"num_read_kb":1170709,"num_write":294860,"num_write_kb":1179353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'319263","reported_seq":627485,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:02.118574+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:46:02.118574+0000","last_peered":"2023-09-23T08:46:02.118574+0000","last_clean":"2023-09-23T08:46:02.118574+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:46:02.118574+0000","last_undegraded":"2023-09-23T08:46:02.118574+0000","last_fullsized":"2023-09-23T08:46:02.118574+0000","mapping_epoch":13,"log_start":"88'309206","ondisk_log_start":"88'309206","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2880664086,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":307134,"num_read_kb":1208703,"num_write":303438,"num_write_kb":1213635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":268,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:45.336368+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:42:45.336368+0000","last_peered":"2023-09-23T08:42:45.336368+0000","last_clean":"2023-09-23T08:42:45.336368+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:42:45.336368+0000","last_undegraded":"2023-09-23T08:42:45.336368+0000","last_fullsized":"2023-09-23T08:42:45.336368+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23745088299,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2507578,"num_read_kb":9876007,"num_write":2487031,"num_write_kb":9947149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18878197760,"data_stored":22834808406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80411,"ondisk_log_size":80411,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739441,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5339104,"kb_used_data":3414616,"kb_used_omap":321,"kb_used_meta":1924158,"kb_avail":89032736,"statfs":{"total":96636764160,"available":91169521664,"internally_reserved":0,"allocated":3496566784,"data_stored":4221118878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":1970338396},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,2,2,4,1,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.79300000000000004,"15min":0.84799999999999998},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":5.3979999999999997,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":5.4329999999999998,"5min":7.492,"15min":14.997999999999999},"last":0.46999999999999997}]},{"osd":1,"last update":"Sat Sep 23 08:45:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.135,"15min":1.1319999999999999},"min":{"1min":0.26500000000000001,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":5.9610000000000003,"5min":8.7210000000000001,"15min":10.759},"last":4.3869999999999996},{"interface":"front","average":{"1min":1.298,"5min":1.3220000000000001,"15min":1.3180000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":6.1799999999999997,"5min":10.766999999999999,"15min":12.379},"last":0.372}]}]},{"osd":1,"up_from":8,"seq":34359739425,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10304724,"kb_used_data":9217348,"kb_used_omap":899,"kb_used_meta":1086460,"kb_avail":84067116,"statfs":{"total":96636764160,"available":86084726784,"internally_reserved":0,"allocated":9438564352,"data_stored":11417170384,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":1112535775},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,0,7,5,9,5,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.73099999999999998,"15min":0.76600000000000001},"min":{"1min":0.22,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":10.898,"5min":10.898,"15min":11.917},"last":0.31900000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.0900000000000001,"15min":1.2030000000000001},"min":{"1min":0.19600000000000001,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":15.718},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.0669999999999999,"15min":0.90400000000000003},"min":{"1min":0.248,"5min":0.183,"15min":0.183},"max":{"1min":7.2830000000000004,"5min":7.4020000000000001,"15min":10.798999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.84799999999999998,"15min":0.79100000000000004},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.23000000000000001},"max":{"1min":2.1819999999999999,"5min":7.4000000000000004,"15min":7.8170000000000002},"last":0.35999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739436,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7371900,"kb_used_data":5805492,"kb_used_omap":551,"kb_used_meta":1565848,"kb_avail":86999940,"statfs":{"total":96636764160,"available":89087938560,"internally_reserved":0,"allocated":5944823808,"data_stored":7198125239,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1603428779},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,0,10,2,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.0149999999999999,"15min":1.169},"min":{"1min":0.188,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":5.5129999999999999,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.0600000000000001,"15min":1.2629999999999999},"min":{"1min":0.27000000000000002,"5min":0.224,"15min":0.224},"max":{"1min":5.548,"5min":7.944,"15min":17.251000000000001},"last":0.38800000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.82599999999999996,"15min":0.79600000000000004},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.193},"max":{"1min":3.532,"5min":6.1959999999999997,"15min":8.7699999999999996},"last":0.308},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.68200000000000005,"15min":0.61099999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.184},"max":{"1min":4.0190000000000001,"5min":5.8310000000000004,"15min":7.0410000000000004},"last":0.41899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5944152064,"data_stored":7197337106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9437925376,"data_stored":11416402731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3496120320,"data_stored":4221068569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:46:07.747 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:46:07.747 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:46:07.747 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:46:10.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.603+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:10.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.615+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:10.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:10.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:10.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.679+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:10.733 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.727+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:10.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:10.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:10.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:10.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:10.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:10.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:10.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.819+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:10.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.839+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:10.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.855+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:10.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:10.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:10.889 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:10.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:10.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:10.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:10.932 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:10.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:11.163 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:11.159+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:46:11.163 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:11.159+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:46:11.163 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:11.159+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:46:13.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:13.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:13.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:13.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:13.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:13.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:13.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:13.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.347+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:13.382 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:13.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:13.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.639+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:13.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.651+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:13.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:13.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.703+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:13.713 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.707+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:13.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:13.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:14.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:14.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:14.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:14.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.355+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:14.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:14.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.383+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:14.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:14.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:14.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:14.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.535+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:14.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:14.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:14.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:14.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:15.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:15.911+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:15.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:15.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:15.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:15.963+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:15.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:15.971+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:16.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:16.011+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:16.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:16.019+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:17.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:17.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:17.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:17.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.287+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:17.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:17.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:17.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:17.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:17.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:17.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:17.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:17.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:17.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.479+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:17.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:17.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:17.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:17.517 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:17.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:18.700 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:18.695+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:18.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:18.699+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:18.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:18.715+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:18.743 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:18.735+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:18.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:18.739+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:18.759 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:18.751+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:18.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:18.791+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:19.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.079+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:19.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.115+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:19.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.131+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:19.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.151+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:19.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.183+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:19.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.191+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:19.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:19.239 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:19.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.247+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:19.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:19.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.399+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:19.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:19.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:19.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:19.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.475+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:19.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:19.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:21.209 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.203+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:21.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.223+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:21.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:21.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:21.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.235+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:21.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:21.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:21.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.775+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:21.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.783+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:21.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:21.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:21.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:21.875+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:22.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.259+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:22.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:22.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:22.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.283+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:22.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:22.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.351+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:22.365 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.359+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:22.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:22.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.391+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:22.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.411+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:22.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:22.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:22.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.467+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:22.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:22.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:22.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.511+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:22.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.543+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:22.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:22.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.547+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:22.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.951+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:22.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:22.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:22.983+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:23.053 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:23.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.063+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:23.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:23.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.071+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:23.095 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.091+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:23.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:23.126 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.119+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:23.140 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.135+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:23.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:23.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:23.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.327+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:23.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:23.373 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.367+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:23.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.375+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:23.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.407+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:23.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:23.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.463+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:23.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:23.489 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:23.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:24.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:24.171+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:24.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:24.187+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:24.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:24.195+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:24.250 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:24.243+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:24.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:24.263+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:24.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:24.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:24.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:24.299+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:24.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:24.303+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:24.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:24.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:24.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:24.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:27.749 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:46:28.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:28.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.439+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:28.451 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:46:28.452 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:46:28.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.447+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:28.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:28.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:28.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:28.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:28.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:28.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:28.493 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.487+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:28.516 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2778,"stamp":"2023-09-23T08:46:26.668417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23761763659,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2515184,"num_read_kb":9906070,"num_write":2495038,"num_write_kb":9980523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80412,"ondisk_log_size":80412,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23326148,"kb_used_data":18473064,"kb_used_omap":1772,"kb_used_meta":4851283,"kb_avail":259789372,"statfs":{"total":289910292480,"available":266024316928,"internally_reserved":0,"allocated":18916417536,"data_stored":22867634213,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1814810,"internal_metadata":4967714534},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,13,14,8,20,21,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8400896,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3961,"num_read_kb":15832,"num_write":4118,"num_write_kb":16472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001944"},"pg_stats":[{"pgid":"2.7","version":"88'309933","reported_seq":608795,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:22.829715+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:46:22.829715+0000","last_peered":"2023-09-23T08:46:22.829715+0000","last_clean":"2023-09-23T08:46:22.829715+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:46:22.829715+0000","last_undegraded":"2023-09-23T08:46:22.829715+0000","last_fullsized":"2023-09-23T08:46:22.829715+0000","mapping_epoch":13,"log_start":"88'299911","ondisk_log_start":"88'299911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2800632143,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":297682,"num_read_kb":1172498,"num_write":294091,"num_write_kb":1176268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'341316","reported_seq":670830,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:46:22.854742+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:46:22.854742+0000","last_peered":"2023-09-23T08:46:22.854742+0000","last_clean":"2023-09-23T08:46:22.854742+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:46:22.854742+0000","last_undegraded":"2023-09-23T08:46:22.854742+0000","last_fullsized":"2023-09-23T08:46:22.854742+0000","mapping_epoch":13,"log_start":"88'331308","ondisk_log_start":"88'331308","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1015,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 531s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3129028927,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":329126,"num_read_kb":1292238,"num_write":325675,"num_write_kb":1302469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'323180","reported_seq":633342,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:46:22.796950+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:46:22.796950+0000","last_peered":"2023-09-23T08:46:22.796950+0000","last_clean":"2023-09-23T08:46:22.796950+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:46:22.796950+0000","last_undegraded":"2023-09-23T08:46:22.796950+0000","last_fullsized":"2023-09-23T08:46:22.796950+0000","mapping_epoch":13,"log_start":"88'313111","ondisk_log_start":"88'313111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1036,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 479s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2913177900,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":308971,"num_read_kb":1216889,"num_write":307484,"num_write_kb":1229849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'328596","reported_seq":656793,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:22.785905+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:46:22.785905+0000","last_peered":"2023-09-23T08:46:22.785905+0000","last_clean":"2023-09-23T08:46:22.785905+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:46:22.785905+0000","last_undegraded":"2023-09-23T08:46:22.785905+0000","last_fullsized":"2023-09-23T08:46:22.785905+0000","mapping_epoch":13,"log_start":"88'318512","ondisk_log_start":"88'318512","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3117187354,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":328573,"num_read_kb":1300115,"num_write":326973,"num_write_kb":1307805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'320454","reported_seq":639246,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:25.008532+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:46:25.008532+0000","last_peered":"2023-09-23T08:46:25.008532+0000","last_clean":"2023-09-23T08:46:25.008532+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:46:25.008532+0000","last_undegraded":"2023-09-23T08:46:25.008532+0000","last_fullsized":"2023-09-23T08:46:25.008532+0000","mapping_epoch":13,"log_start":"88'310409","ondisk_log_start":"88'310409","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3008897342,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":318215,"num_read_kb":1253587,"num_write":316786,"num_write_kb":1266994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'331120","reported_seq":658485,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:24.534388+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:46:24.534388+0000","last_peered":"2023-09-23T08:46:24.534388+0000","last_clean":"2023-09-23T08:46:24.534388+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:46:24.534388+0000","last_undegraded":"2023-09-23T08:46:24.534388+0000","last_fullsized":"2023-09-23T08:46:24.534388+0000","mapping_epoch":13,"log_start":"88'321111","ondisk_log_start":"88'321111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3099005398,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":326198,"num_read_kb":1284120,"num_write":323678,"num_write_kb":1294592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'303144","reported_seq":602628,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:24.545643+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:46:24.545643+0000","last_peered":"2023-09-23T08:46:24.545643+0000","last_clean":"2023-09-23T08:46:24.545643+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:46:24.545643+0000","last_undegraded":"2023-09-23T08:46:24.545643+0000","last_fullsized":"2023-09-23T08:46:24.545643+0000","mapping_epoch":13,"log_start":"88'293108","ondisk_log_start":"88'293108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2810437933,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":298249,"num_read_kb":1174109,"num_write":295756,"num_write_kb":1182937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'320346","reported_seq":629515,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:22.794720+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:46:22.794720+0000","last_peered":"2023-09-23T08:46:22.794720+0000","last_clean":"2023-09-23T08:46:22.794720+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:46:22.794720+0000","last_undegraded":"2023-09-23T08:46:22.794720+0000","last_fullsized":"2023-09-23T08:46:22.794720+0000","mapping_epoch":13,"log_start":"88'310306","ondisk_log_start":"88'310306","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2882806294,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":308064,"num_read_kb":1212423,"num_write":304458,"num_write_kb":1217715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":268,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:45.336368+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:42:45.336368+0000","last_peered":"2023-09-23T08:42:45.336368+0000","last_clean":"2023-09-23T08:42:45.336368+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:42:45.336368+0000","last_undegraded":"2023-09-23T08:42:45.336368+0000","last_fullsized":"2023-09-23T08:42:45.336368+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23761173291,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2515078,"num_read_kb":9905979,"num_write":2494901,"num_write_kb":9978629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18914942976,"data_stored":22866253398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80313,"ondisk_log_size":80313,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5377596,"kb_used_data":3421168,"kb_used_omap":321,"kb_used_meta":1956094,"kb_avail":88994244,"statfs":{"total":96636764160,"available":91130105856,"internally_reserved":0,"allocated":3503276032,"data_stored":4226910622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":2003040860},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,6,0,0,1,10,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.79300000000000004,"15min":0.84799999999999998},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":5.3979999999999997,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":0.315},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":5.4329999999999998,"5min":7.492,"15min":14.997999999999999},"last":0.36099999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:45:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.135,"15min":1.1319999999999999},"min":{"1min":0.26500000000000001,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":5.9610000000000003,"5min":8.7210000000000001,"15min":10.759},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.298,"5min":1.3220000000000001,"15min":1.3180000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":6.1799999999999997,"5min":10.766999999999999,"15min":12.379},"last":0.34799999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739429,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10471192,"kb_used_data":9235280,"kb_used_omap":899,"kb_used_meta":1235004,"kb_avail":83900648,"statfs":{"total":96636764160,"available":85914263552,"internally_reserved":0,"allocated":9456926720,"data_stored":11432903120,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":1264644831},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,10,6,16,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:45:28 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.73099999999999998,"15min":0.76600000000000001},"min":{"1min":0.22,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":10.898,"5min":10.898,"15min":11.917},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.0900000000000001,"15min":1.2030000000000001},"min":{"1min":0.19600000000000001,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":15.718},"last":0.25800000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:45:28 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.0669999999999999,"15min":0.90400000000000003},"min":{"1min":0.248,"5min":0.183,"15min":0.183},"max":{"1min":7.2830000000000004,"5min":7.4020000000000001,"15min":10.798999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.84799999999999998,"15min":0.79100000000000004},"min":{"1min":0.26100000000000001,"5min":0.25700000000000001,"15min":0.23000000000000001},"max":{"1min":2.1819999999999999,"5min":7.4000000000000004,"15min":7.8170000000000002},"last":0.52000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739440,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7477360,"kb_used_data":5816616,"kb_used_omap":551,"kb_used_meta":1660184,"kb_avail":86894480,"statfs":{"total":96636764160,"available":88979947520,"internally_reserved":0,"allocated":5956214784,"data_stored":7207820471,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1700028843},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,4,2,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.0149999999999999,"15min":1.169},"min":{"1min":0.188,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":5.5129999999999999,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.0600000000000001,"15min":1.2629999999999999},"min":{"1min":0.27000000000000002,"5min":0.224,"15min":0.224},"max":{"1min":5.548,"5min":7.944,"15min":17.251000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.86499999999999999,"15min":0.81000000000000005},"min":{"1min":0.223,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":7.6799999999999997,"5min":7.6799999999999997,"15min":8.7699999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.71899999999999997,"15min":0.65100000000000002},"min":{"1min":0.27300000000000002,"5min":0.248,"15min":0.184},"max":{"1min":7.641,"5min":7.641,"15min":7.641},"last":0.313}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5955440640,"data_stored":7206946322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9456582656,"data_stored":11432389419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3502919680,"data_stored":4226917657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:46:28.517 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:46:28.517 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:46:28.518 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:46:28.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:28.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.815+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:28.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:28.858 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.851+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:28.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.863+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:28.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.887+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:28.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.907+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:28.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:28.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:32.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.003+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:32.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.007+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:32.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:32.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:32.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:32.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:32.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.031+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:32.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:32.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:32.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.395+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:32.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.415+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:32.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.435+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:32.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.455+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:32.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.459+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:32.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:32.491+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:39.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:39.827+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:39.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:39.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:39.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:39.879+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:39.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:39.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:39.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:39.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:39.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:39.883+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:39.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:39.891+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:39.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:39.903+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:40.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.143+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:40.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.147+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:40.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:40.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.227+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:40.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:40.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:40.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.271+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:40.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.291+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:40.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:40.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.295+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:40.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.307+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:40.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.319+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:40.329 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.323+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:40.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.343+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:40.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.451+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:40.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.507+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:40.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:40.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.527+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:40.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.551+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:40.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.555+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:40.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:40.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:40.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:43.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.167+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:43.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.179+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:43.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:43.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.207+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:43.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.219+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:43.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:43.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.231+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:43.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.251+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:43.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.255+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:43.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:43.535 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:43.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.591+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:43.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:43.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.599+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:43.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.611+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:43.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:43.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:43.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.627+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:43.681 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.675+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:43.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.771+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:43.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.787+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:43.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:43.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.795+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:43.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.803+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:43.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.823+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:43.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.871+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:43.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.895+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:43.905 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.899+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:43.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.915+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:43.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.919+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:43.934 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.927+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:43.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.947+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:43.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:43.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.967+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:43.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:44.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:44.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:44.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:43.999+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:44.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:44.027+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:44.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:44.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:44.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:44.047+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:44.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:44.099+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:44.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:44.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:44.110 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:44.103+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:44.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:44.975+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:44.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:44.979+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:44.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:44.991+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:45.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.035+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:45.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.051+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:45.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.067+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:45.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:45.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.111+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:45.537 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:45.531+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:46:45.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.563+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:45.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.583+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:45.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.595+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:45.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.631+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:45.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.635+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:45.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:45.643+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:47.078 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:47.071+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:46:47.078 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:47.071+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:46:47.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.471+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:47.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.483+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:47.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.503+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:47.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.519+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:47.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:47.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:47.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.523+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:47.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.531+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:47.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:47.545 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.539+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:47.567 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:47.559+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:48.519 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:46:48.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:48.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:48.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:48.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:48.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:48.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:48.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:48.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:48.866 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:48.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:48.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:48.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:48.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:48.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:48.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:48.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:48.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:48.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:48.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:48.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:46:49.446 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:46:49.489 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2789,"stamp":"2023-09-23T08:46:48.672649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23777897803,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2522788,"num_read_kb":9936482,"num_write":2503010,"num_write_kb":10012411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80404,"ondisk_log_size":80404,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23665160,"kb_used_data":18509672,"kb_used_omap":1772,"kb_used_meta":5153683,"kb_avail":259450360,"statfs":{"total":289910292480,"available":265677168640,"internally_reserved":0,"allocated":18953904128,"data_stored":22899914789,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1814810,"internal_metadata":5277372134},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,12,9,23,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8409088,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3931,"num_read_kb":15724,"num_write":4134,"num_write_kb":16536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001918"},"pg_stats":[{"pgid":"2.7","version":"88'310900","reported_seq":610674,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:43.579456+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:46:43.579456+0000","last_peered":"2023-09-23T08:46:43.579456+0000","last_clean":"2023-09-23T08:46:43.579456+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:46:43.579456+0000","last_undegraded":"2023-09-23T08:46:43.579456+0000","last_fullsized":"2023-09-23T08:46:43.579456+0000","mapping_epoch":13,"log_start":"88'300811","ondisk_log_start":"88'300811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2802454863,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":298580,"num_read_kb":1176086,"num_write":295019,"num_write_kb":1179980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'342419","reported_seq":672971,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:46:43.536338+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:46:43.536338+0000","last_peered":"2023-09-23T08:46:43.536338+0000","last_clean":"2023-09-23T08:46:43.536338+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:46:43.536338+0000","last_undegraded":"2023-09-23T08:46:43.536338+0000","last_fullsized":"2023-09-23T08:46:43.536338+0000","mapping_epoch":13,"log_start":"88'332408","ondisk_log_start":"88'332408","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1035,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 552s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3131089215,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":330149,"num_read_kb":1296330,"num_write":326730,"num_write_kb":1306689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'324219","reported_seq":635327,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:46:43.548095+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:46:43.548095+0000","last_peered":"2023-09-23T08:46:43.548095+0000","last_clean":"2023-09-23T08:46:43.548095+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:46:43.548095+0000","last_undegraded":"2023-09-23T08:46:43.548095+0000","last_fullsized":"2023-09-23T08:46:43.548095+0000","mapping_epoch":13,"log_start":"88'314211","ondisk_log_start":"88'314211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1088,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 500s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2915299628,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":309901,"num_read_kb":1220609,"num_write":308454,"num_write_kb":1233729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'329624","reported_seq":658818,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:43.517789+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:46:43.517789+0000","last_peered":"2023-09-23T08:46:43.517789+0000","last_clean":"2023-09-23T08:46:43.517789+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:46:43.517789+0000","last_undegraded":"2023-09-23T08:46:43.517789+0000","last_fullsized":"2023-09-23T08:46:43.517789+0000","mapping_epoch":13,"log_start":"88'319612","ondisk_log_start":"88'319612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3119231258,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":329570,"num_read_kb":1304103,"num_write":328001,"num_write_kb":1311917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'321569","reported_seq":641428,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:48.387229+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:46:48.387229+0000","last_peered":"2023-09-23T08:46:48.387229+0000","last_clean":"2023-09-23T08:46:48.387229+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:46:48.387229+0000","last_undegraded":"2023-09-23T08:46:48.387229+0000","last_fullsized":"2023-09-23T08:46:48.387229+0000","mapping_epoch":13,"log_start":"88'311509","ondisk_log_start":"88'311509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3011346750,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":319271,"num_read_kb":1257811,"num_write":317891,"num_write_kb":1271414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'332130","reported_seq":660413,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:44.796883+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:46:44.796883+0000","last_peered":"2023-09-23T08:46:44.796883+0000","last_clean":"2023-09-23T08:46:44.796883+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:46:44.796883+0000","last_undegraded":"2023-09-23T08:46:44.796883+0000","last_fullsized":"2023-09-23T08:46:44.796883+0000","mapping_epoch":13,"log_start":"88'322111","ondisk_log_start":"88'322111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3101024726,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":327106,"num_read_kb":1287752,"num_write":324682,"num_write_kb":1298608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'304028","reported_seq":604435,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:44.806855+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:46:44.806855+0000","last_peered":"2023-09-23T08:46:44.806855+0000","last_clean":"2023-09-23T08:46:44.806855+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:46:44.806855+0000","last_undegraded":"2023-09-23T08:46:44.806855+0000","last_fullsized":"2023-09-23T08:46:44.806855+0000","mapping_epoch":13,"log_start":"88'294008","ondisk_log_start":"88'294008","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2812174637,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":299161,"num_read_kb":1177757,"num_write":296634,"num_write_kb":1186449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'321392","reported_seq":631449,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:43.392563+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:46:43.392563+0000","last_peered":"2023-09-23T08:46:43.392563+0000","last_clean":"2023-09-23T08:46:43.392563+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:46:43.392563+0000","last_undegraded":"2023-09-23T08:46:43.392563+0000","last_fullsized":"2023-09-23T08:46:43.392563+0000","mapping_epoch":13,"log_start":"88'311306","ondisk_log_start":"88'311306","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2884686358,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":308944,"num_read_kb":1215943,"num_write":305462,"num_write_kb":1221731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":268,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:42:45.336368+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:42:45.336368+0000","last_peered":"2023-09-23T08:42:45.336368+0000","last_clean":"2023-09-23T08:42:45.336368+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:42:45.336368+0000","last_undegraded":"2023-09-23T08:42:45.336368+0000","last_fullsized":"2023-09-23T08:42:45.336368+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23777307435,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2522682,"num_read_kb":9936391,"num_write":2502873,"num_write_kb":10010517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18953191424,"data_stored":22899209814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80305,"ondisk_log_size":80305,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739450,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5433936,"kb_used_data":3427528,"kb_used_omap":321,"kb_used_meta":2006078,"kb_avail":88937904,"statfs":{"total":96636764160,"available":91072413696,"internally_reserved":0,"allocated":3509788672,"data_stored":4232567198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":2054224476},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,2,8,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:46:41 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":0.92200000000000004,"15min":0.86699999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":4.5940000000000003,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":0.316},{"interface":"front","average":{"1min":1.0980000000000001,"5min":0.88300000000000001,"15min":0.79900000000000004},"min":{"1min":0.218,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":5.5119999999999996,"5min":7.492,"15min":14.997999999999999},"last":0.49199999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:46:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.173,"15min":1.1739999999999999},"min":{"1min":0.30099999999999999,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":4.5670000000000002,"5min":6.4960000000000004,"15min":10.759},"last":1.7969999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":1.1830000000000001,"15min":1.2749999999999999},"min":{"1min":0.23300000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":3.758,"5min":6.1799999999999997,"15min":12.379},"last":0.34000000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739433,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10636872,"kb_used_data":9252860,"kb_used_omap":899,"kb_used_meta":1383100,"kb_avail":83734968,"statfs":{"total":96636764160,"available":85744607232,"internally_reserved":0,"allocated":9474928640,"data_stored":11448381904,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":1416295135},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,10,5,11,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79500000000000004,"15min":0.78200000000000003},"min":{"1min":0.219,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":4.274,"5min":10.898,"15min":11.917},"last":1.4339999999999999},{"interface":"front","average":{"1min":0.871,"5min":1.0589999999999999,"15min":1.1930000000000001},"min":{"1min":0.25800000000000001,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":5.3890000000000002,"5min":10.992000000000001,"15min":15.718},"last":0.33700000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:46:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.147,"15min":0.94999999999999996},"min":{"1min":0.23799999999999999,"5min":0.183,"15min":0.183},"max":{"1min":11.372,"5min":11.372,"15min":11.372},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":0.84399999999999997,"15min":0.83499999999999996},"min":{"1min":0.28999999999999998,"5min":0.25700000000000001,"15min":0.24299999999999999},"max":{"1min":6.016,"5min":7.2370000000000001,"15min":7.8170000000000002},"last":1.7050000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7594352,"kb_used_data":5829284,"kb_used_omap":551,"kb_used_meta":1764504,"kb_avail":86777488,"statfs":{"total":96636764160,"available":88860147712,"internally_reserved":0,"allocated":5969186816,"data_stored":7218965687,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1806852523},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,2,4,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:46:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0369999999999999,"15min":1.1220000000000001},"min":{"1min":0.20599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":6.5010000000000003,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.081,"15min":1.1970000000000001},"min":{"1min":0.36099999999999999,"5min":0.224,"15min":0.224},"max":{"1min":6.5330000000000004,"5min":7.944,"15min":17.251000000000001},"last":0.374}]},{"osd":2,"last update":"Sat Sep 23 08:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.86499999999999999,"15min":0.81000000000000005},"min":{"1min":0.223,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":7.6799999999999997,"5min":7.6799999999999997,"15min":8.7699999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.71899999999999997,"15min":0.65100000000000002},"min":{"1min":0.27300000000000002,"5min":0.248,"15min":0.184},"max":{"1min":7.641,"5min":7.641,"15min":7.641},"last":0.34300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5968777216,"data_stored":7218390546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9475022848,"data_stored":11448257323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3509391360,"data_stored":4232561945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:46:49.490 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:46:49.491 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:46:49.491 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:46:49.919 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:49.910+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:46:49.919 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:49.910+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:46:49.938 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:49.930+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:46:49.938 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:49.930+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:46:49.939 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:49.930+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:46:50.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:50.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:50.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:50.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:50.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:50.319 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:50.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:50.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:50.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:50.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:50.374 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:50.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:51.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:51.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:51.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:51.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:51.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:51.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:51.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:51.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:51.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:51.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:51.812 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:51.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:51.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:51.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:51.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.882+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:51.896 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:51.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:51.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:51.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:52.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.422+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:52.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:52.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:52.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:52.507 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:52.532 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:52.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:52.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:52.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:52.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:52.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:52.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.818+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:52.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:52.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:52.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:52.902 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:52.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.918+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:52.940 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:52.934+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:53.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:53.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:53.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:53.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:53.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:53.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:53.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:53.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:53.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:53.182+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:53.216 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:53.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:53.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:53.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:54.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:54.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:54.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:54.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:54.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:54.401 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:54.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:54.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:54.412 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:54.445 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:54.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:54.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:54.826 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:54.818+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:46:54.826 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:54.818+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:46:54.841 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:54.834+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:46:54.842 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:54.834+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:46:54.842 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:54.834+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:46:55.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:55.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:55.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:55.922+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:55.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:55.938+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:56.058 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:56.050+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:46:56.058 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:46:56.050+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:46:56.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:56.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:56.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:56.394+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:56.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:56.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:56.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:56.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:56.503 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:56.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:56.524 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:56.518+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:56.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:56.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:56.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:56.558+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:57.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:57.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:57.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:57.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:57.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:57.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:57.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:57.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:57.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:57.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:57.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:57.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:57.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:57.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:57.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:57.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:57.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:57.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:58.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:58.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:58.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:58.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:58.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:58.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:58.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:58.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:58.870 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:58.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:58.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:58.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:58.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:58.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:58.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:58.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:58.903 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:58.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:58.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:58.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:59.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:59.263 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:59.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:59.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:59.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:59.317 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:59.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:59.336 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.330+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:59.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.362+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:59.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:59.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:59.407 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.402+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:46:59.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:46:59.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:46:59.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:46:59.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:46:59.465 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:46:59.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:46:59.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:46:59.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:46:59.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:46:59.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:46:59.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:46:59.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:46:59.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:01.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:01.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:01.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:01.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:01.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:01.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:01.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:01.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:01.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:01.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:01.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:01.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:01.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:01.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:01.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:01.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:01.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:01.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:03.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:03.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:03.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:03.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:03.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:03.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.238+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:03.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.258+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:03.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.278+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:03.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:03.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.286+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:03.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:03.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:03.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:03.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:03.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:03.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:03.392 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:03.417 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:03.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:04.880 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:04.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:04.938 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:04.930+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:04.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:04.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:04.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:04.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:04.986 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:04.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:05.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.034+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:05.055 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:05.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:05.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:05.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:05.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:05.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.326+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:05.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.342+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:05.391 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.386+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:05.414 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:05.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:05.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:05.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:05.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:05.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:05.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:05.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:05.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:05.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.798+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:05.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:05.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.850+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:05.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.866+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:05.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:05.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:06.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:06.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:06.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:06.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:06.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:06.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:06.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:06.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:06.555 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:06.556 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:06.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:06.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:06.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.782+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:06.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:06.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:06.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:06.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:06.847 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:06.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:07.612 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:07.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:07.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:07.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:07.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:07.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:07.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:07.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:07.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:07.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:07.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:07.730+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:07.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:07.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:07.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:07.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:08.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.066+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:08.086 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:08.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:08.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:08.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:08.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.134+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:08.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:08.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:08.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:08.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:08.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:08.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:08.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.390+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:08.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:08.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:08.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:08.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:08.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:08.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:08.589 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:08.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:08.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.606+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:08.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:08.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:08.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:08.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:08.669 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:08.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:08.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:08.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:08.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:08.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:08.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:08.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:08.801 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:08.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.838+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:08.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:08.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:09.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.026+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:09.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:09.091 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.082+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:09.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.086+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:09.097 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.090+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:09.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.098+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:09.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:09.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:09.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.126+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:09.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:09.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.138+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:09.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.158+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:09.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:09.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:09.492 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:47:09.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:09.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:09.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.830+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:09.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:09.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:09.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:09.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:09.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:09.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:10.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:09.994+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:10.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:10.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:10.437 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:47:10.438 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:47:10.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:10.468 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2799,"stamp":"2023-09-23T08:47:08.678960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23793597771,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2530159,"num_read_kb":9965962,"num_write":2510857,"num_write_kb":10043799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80425,"ondisk_log_size":80425,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24032620,"kb_used_data":18545096,"kb_used_omap":1772,"kb_used_meta":5485715,"kb_avail":259082900,"statfs":{"total":289910292480,"available":265300889600,"internally_reserved":0,"allocated":18990178304,"data_stored":22931343397,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1814810,"internal_metadata":5617372902},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,2,1,8,7,13,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8306688,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3885,"num_read_kb":15536,"num_write":4136,"num_write_kb":16544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004989"},"pg_stats":[{"pgid":"2.7","version":"88'311938","reported_seq":612574,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:04.519713+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:47:04.519713+0000","last_peered":"2023-09-23T08:47:04.519713+0000","last_clean":"2023-09-23T08:47:04.519713+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:47:04.519713+0000","last_undegraded":"2023-09-23T08:47:04.519713+0000","last_fullsized":"2023-09-23T08:47:04.519713+0000","mapping_epoch":13,"log_start":"88'301911","ondisk_log_start":"88'301911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2804412751,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":299429,"num_read_kb":1179482,"num_write":295991,"num_write_kb":1183868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'343562","reported_seq":675103,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:47:04.382908+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:47:04.382908+0000","last_peered":"2023-09-23T08:47:04.382908+0000","last_clean":"2023-09-23T08:47:04.382908+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:47:04.382908+0000","last_undegraded":"2023-09-23T08:47:04.382908+0000","last_fullsized":"2023-09-23T08:47:04.382908+0000","mapping_epoch":13,"log_start":"88'333508","ondisk_log_start":"88'333508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1078,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 573s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3133215039,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":331118,"num_read_kb":1300206,"num_write":327791,"num_write_kb":1310933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'325283","reported_seq":637361,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:47:04.391865+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:47:04.391865+0000","last_peered":"2023-09-23T08:47:04.391865+0000","last_clean":"2023-09-23T08:47:04.391865+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:47:04.391865+0000","last_undegraded":"2023-09-23T08:47:04.391865+0000","last_fullsized":"2023-09-23T08:47:04.391865+0000","mapping_epoch":13,"log_start":"88'315211","ondisk_log_start":"88'315211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1136,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 521s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2917183788,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":310849,"num_read_kb":1224401,"num_write":309422,"num_write_kb":1237601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'330703","reported_seq":660906,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:04.448797+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:47:04.448797+0000","last_peered":"2023-09-23T08:47:04.448797+0000","last_clean":"2023-09-23T08:47:04.448797+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:47:04.448797+0000","last_undegraded":"2023-09-23T08:47:04.448797+0000","last_fullsized":"2023-09-23T08:47:04.448797+0000","mapping_epoch":13,"log_start":"88'320612","ondisk_log_start":"88'320612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3121385754,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":330583,"num_read_kb":1308151,"num_write":329080,"num_write_kb":1316233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'322528","reported_seq":643285,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:08.613320+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:47:08.613320+0000","last_peered":"2023-09-23T08:47:08.613320+0000","last_clean":"2023-09-23T08:47:08.613320+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:47:08.613320+0000","last_undegraded":"2023-09-23T08:47:08.613320+0000","last_fullsized":"2023-09-23T08:47:08.613320+0000","mapping_epoch":13,"log_start":"88'312509","ondisk_log_start":"88'312509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3013173566,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":320166,"num_read_kb":1261391,"num_write":318840,"num_write_kb":1275210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'333146","reported_seq":662356,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:04.959930+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:47:04.959930+0000","last_peered":"2023-09-23T08:47:04.959930+0000","last_clean":"2023-09-23T08:47:04.959930+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:47:04.959930+0000","last_undegraded":"2023-09-23T08:47:04.959930+0000","last_fullsized":"2023-09-23T08:47:04.959930+0000","mapping_epoch":13,"log_start":"88'323111","ondisk_log_start":"88'323111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3103048150,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":328015,"num_read_kb":1291388,"num_write":325671,"num_write_kb":1302564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'304914","reported_seq":606179,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:04.959457+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:47:04.959457+0000","last_peered":"2023-09-23T08:47:04.959457+0000","last_clean":"2023-09-23T08:47:04.959457+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:47:04.959457+0000","last_undegraded":"2023-09-23T08:47:04.959457+0000","last_fullsized":"2023-09-23T08:47:04.959457+0000","mapping_epoch":13,"log_start":"88'294908","ondisk_log_start":"88'294908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2813956397,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":300007,"num_read_kb":1181141,"num_write":297493,"num_write_kb":1189885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'322428","reported_seq":633440,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:04.352327+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:47:04.352327+0000","last_peered":"2023-09-23T08:47:04.352327+0000","last_clean":"2023-09-23T08:47:04.352327+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:47:04.352327+0000","last_undegraded":"2023-09-23T08:47:04.352327+0000","last_fullsized":"2023-09-23T08:47:04.352327+0000","mapping_epoch":13,"log_start":"88'312406","ondisk_log_start":"88'312406","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2886631958,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":309886,"num_read_kb":1219711,"num_write":306432,"num_write_kb":1225611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":269,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:49.733021+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:44:49.733021+0000","last_peered":"2023-09-23T08:44:49.733021+0000","last_clean":"2023-09-23T08:44:49.733021+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:44:49.733021+0000","last_undegraded":"2023-09-23T08:44:49.733021+0000","last_fullsized":"2023-09-23T08:44:49.733021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23793007403,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2530053,"num_read_kb":9965871,"num_write":2510720,"num_write_kb":10041905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18989346816,"data_stored":22930519638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80326,"ondisk_log_size":80326,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739454,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5507288,"kb_used_data":3434252,"kb_used_omap":321,"kb_used_meta":2072702,"kb_avail":88864552,"statfs":{"total":96636764160,"available":90997301248,"internally_reserved":0,"allocated":3516674048,"data_stored":4238514590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":329124,"internal_metadata":2122447452},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:46:41 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":0.92200000000000004,"15min":0.86699999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":4.5940000000000003,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":0.249},{"interface":"front","average":{"1min":1.0980000000000001,"5min":0.88300000000000001,"15min":0.79900000000000004},"min":{"1min":0.218,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":5.5119999999999996,"5min":7.492,"15min":14.997999999999999},"last":2.4140000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:46:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.173,"15min":1.1739999999999999},"min":{"1min":0.30099999999999999,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":4.5670000000000002,"5min":6.4960000000000004,"15min":10.759},"last":0.433},{"interface":"front","average":{"1min":0.79700000000000004,"5min":1.1830000000000001,"15min":1.2749999999999999},"min":{"1min":0.23300000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":3.758,"5min":6.1799999999999997,"15min":12.379},"last":0.70199999999999996}]}]},{"osd":1,"up_from":8,"seq":34359739437,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10821280,"kb_used_data":9270672,"kb_used_omap":899,"kb_used_meta":1549692,"kb_avail":83550560,"statfs":{"total":96636764160,"available":85555773440,"internally_reserved":0,"allocated":9493168128,"data_stored":11464163792,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":1586885343},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,0,4,6,13,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79500000000000004,"15min":0.78200000000000003},"min":{"1min":0.219,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":4.274,"5min":10.898,"15min":11.917},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.871,"5min":1.0589999999999999,"15min":1.1930000000000001},"min":{"1min":0.25800000000000001,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":5.3890000000000002,"5min":10.992000000000001,"15min":15.718},"last":0.307}]},{"osd":2,"last update":"Sat Sep 23 08:46:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.147,"15min":0.94999999999999996},"min":{"1min":0.23799999999999999,"5min":0.183,"15min":0.183},"max":{"1min":11.372,"5min":11.372,"15min":11.372},"last":0.28599999999999998},{"interface":"front","average":{"1min":1.0820000000000001,"5min":0.84399999999999997,"15min":0.83499999999999996},"min":{"1min":0.28999999999999998,"5min":0.25700000000000001,"15min":0.24299999999999999},"max":{"1min":6.016,"5min":7.2370000000000001,"15min":7.8170000000000002},"last":9.6769999999999996}]}]},{"osd":0,"up_from":8,"seq":34359739450,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7704052,"kb_used_data":5840172,"kb_used_omap":551,"kb_used_meta":1863320,"kb_avail":86667788,"statfs":{"total":96636764160,"available":88747814912,"internally_reserved":0,"allocated":5980336128,"data_stored":7228665015,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1908040107},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,3,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:46:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0369999999999999,"15min":1.1220000000000001},"min":{"1min":0.20599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":6.5010000000000003,"5min":7.8689999999999998,"15min":17.216000000000001},"last":4.2409999999999997},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.081,"15min":1.1970000000000001},"min":{"1min":0.36099999999999999,"5min":0.224,"15min":0.224},"max":{"1min":6.5330000000000004,"5min":7.944,"15min":17.251000000000001},"last":4.3049999999999997}]},{"osd":2,"last update":"Sat Sep 23 08:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.86499999999999999,"15min":0.81000000000000005},"min":{"1min":0.223,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":7.6799999999999997,"5min":7.6799999999999997,"15min":8.7699999999999996},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.71899999999999997,"15min":0.65100000000000002},"min":{"1min":0.27300000000000002,"5min":0.248,"15min":0.184},"max":{"1min":7.641,"5min":7.641,"15min":7.641},"last":4.2729999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5979901952,"data_stored":7228044818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9493475328,"data_stored":11464239915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3515969536,"data_stored":4238234905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:47:10.469 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:47:10.470 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:47:10.470 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-09-23T08:47:10.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.466+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:10.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:10.657 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:10.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:10.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:10.658 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.646+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:10.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:10.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:10.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:10.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:10.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.666+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:10.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:10.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:10.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:10.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:10.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T08:47:10.946+0000 7fdad2ffd640 0 --2- 172.21.15.107:0/1287060506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdad408d430 0x7fdad4081070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-23T08:47:11.462 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-09-23T08:47:11.519 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-09-23T08:47:12.271 INFO:teuthology.orchestra.run.smithi107.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-09-23T08:47:12.304 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:47:15.164 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:15.158+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:47:15.164 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:15.158+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:47:15.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:15.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:15.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:15.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:15.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:15.682+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:15.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:15.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:15.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:15.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:15.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:15.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:15.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:15.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:15.773 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:15.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:15.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:15.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:15.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:15.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:18.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:18.738+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:18.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:18.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:18.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:18.774+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:18.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:18.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:18.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:18.822+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:18.859 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:18.854+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:18.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:18.858+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:18.869 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:18.862+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:19.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:19.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:19.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:19.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:19.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:19.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:19.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:19.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:19.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:19.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:19.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:19.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:19.755 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:19.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:19.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:19.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:19.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:19.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:19.775 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:19.770+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:22.132 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:22.126+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:47:22.132 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:22.126+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:47:22.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.242+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:22.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:22.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:22.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.282+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:22.297 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.290+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:22.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:22.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:22.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:22.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:22.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.446+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:22.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:22.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.490+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:22.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:22.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.538+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:22.583 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:22.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:22.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:22.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:22.732 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:22.726+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:47:22.732 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:22.726+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:47:22.732 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:22.726+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:47:23.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:23.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:23.470 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:23.462+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:23.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:23.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:23.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:23.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:23.488 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:23.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:23.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:23.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:23.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:23.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:23.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:23.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:23.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:23.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:23.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:23.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:24.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:24.470+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:24.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:24.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:24.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:24.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:24.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:24.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:24.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:24.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:24.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:24.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:24.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:24.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:24.732 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:24.726+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:47:25.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:25.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:25.660 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:25.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:25.719 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:25.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:25.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.778+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:25.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:25.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:25.900 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.894+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:25.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.898+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:25.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:25.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.926+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:25.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:25.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.958+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:25.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.970+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:25.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.990+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:26.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:25.998+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:26.035 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:26.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:26.121 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.114+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:26.152 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:26.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:26.184 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:26.242 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:26.234+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:47:26.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:26.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:26.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.254+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:26.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:26.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.270+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:26.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:26.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:26.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.298+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:26.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:26.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.346+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:26.355 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.350+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:26.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.366+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:26.420 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.414+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:26.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:26.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:27.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:27.050+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:27.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:27.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:27.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:27.102+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:27.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:27.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:27.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:27.118+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:28.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:28.426+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:28.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:28.442+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:28.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:28.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:28.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:28.458+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:29.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.106+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:29.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:29.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.142+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:29.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:29.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:29.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:29.183 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.174+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:29.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:29.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:29.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.214+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:29.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:29.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:29.234+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:30.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:30.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.594+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:30.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:30.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:30.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:30.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.674+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:30.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.714+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:30.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:30.725 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.718+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:30.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:30.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:30.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:30.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:30.800 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.794+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:30.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:30.814 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.806+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:30.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.810+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:30.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.814+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:30.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:30.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.886+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:30.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:30.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:31.789 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:31.782+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:47:31.789 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:31.782+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:47:31.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:31.966+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:31.990 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:31.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:32.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.018+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:32.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:32.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:32.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:32.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.058+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:32.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.094+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:32.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.110+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:32.305 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:47:32.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:32.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.914+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:32.956 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.950+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:32.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:32.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:32.954+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:33.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:33.010+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:33.048 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:33.042+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:47:33.094 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:47:33.095 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:47:33.149 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2811,"stamp":"2023-09-23T08:47:32.683390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23812894027,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2539186,"num_read_kb":10002046,"num_write":2520431,"num_write_kb":10082095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80566,"ondisk_log_size":80566,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23895556,"kb_used_data":18586916,"kb_used_omap":1786,"kb_used_meta":5306821,"kb_avail":259219964,"statfs":{"total":289910292480,"available":265441243136,"internally_reserved":0,"allocated":19033001984,"data_stored":22967904293,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1829439,"internal_metadata":5434185153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,13,6,10,13,9,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7872512,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3710,"num_read_kb":14828,"num_write":3946,"num_write_kb":15784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001905"},"pg_stats":[{"pgid":"2.7","version":"88'313191","reported_seq":614933,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:30.422658+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:47:30.422658+0000","last_peered":"2023-09-23T08:47:30.422658+0000","last_clean":"2023-09-23T08:47:30.422658+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:47:30.422658+0000","last_undegraded":"2023-09-23T08:47:30.422658+0000","last_fullsized":"2023-09-23T08:47:30.422658+0000","mapping_epoch":13,"log_start":"88'303111","ondisk_log_start":"88'303111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2806899023,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":300522,"num_read_kb":1183854,"num_write":297162,"num_write_kb":1188552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'344932","reported_seq":677693,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:47:30.382654+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:47:30.382654+0000","last_peered":"2023-09-23T08:47:30.382654+0000","last_clean":"2023-09-23T08:47:30.382654+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:47:30.382654+0000","last_undegraded":"2023-09-23T08:47:30.382654+0000","last_fullsized":"2023-09-23T08:47:30.382654+0000","mapping_epoch":13,"log_start":"88'334908","ondisk_log_start":"88'334908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1120,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 599s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3135734079,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":332312,"num_read_kb":1304982,"num_write":329041,"num_write_kb":1315933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'326614","reported_seq":639900,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:47:30.427979+0000","last_change":"2023-09-23T08:38:22.898574+0000","last_active":"2023-09-23T08:47:30.427979+0000","last_peered":"2023-09-23T08:47:30.427979+0000","last_clean":"2023-09-23T08:47:30.427979+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:47:30.427979+0000","last_undegraded":"2023-09-23T08:47:30.427979+0000","last_fullsized":"2023-09-23T08:47:30.427979+0000","mapping_epoch":13,"log_start":"88'316611","ondisk_log_start":"88'316611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1209,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 547s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2919690540,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":312030,"num_read_kb":1229121,"num_write":310632,"num_write_kb":1242441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'332009","reported_seq":663436,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:30.343389+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:47:30.343389+0000","last_peered":"2023-09-23T08:47:30.343389+0000","last_clean":"2023-09-23T08:47:30.343389+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:47:30.343389+0000","last_undegraded":"2023-09-23T08:47:30.343389+0000","last_fullsized":"2023-09-23T08:47:30.343389+0000","mapping_epoch":13,"log_start":"88'321912","ondisk_log_start":"88'321912","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3123982618,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":331803,"num_read_kb":1313031,"num_write":330386,"num_write_kb":1321457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'323535","reported_seq":645265,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:28.827704+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:47:28.827704+0000","last_peered":"2023-09-23T08:47:28.827704+0000","last_clean":"2023-09-23T08:47:28.827704+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:47:28.827704+0000","last_undegraded":"2023-09-23T08:47:28.827704+0000","last_fullsized":"2023-09-23T08:47:28.827704+0000","mapping_epoch":13,"log_start":"88'313509","ondisk_log_start":"88'313509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3015196990,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":321129,"num_read_kb":1265239,"num_write":319841,"num_write_kb":1279214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'334394","reported_seq":664757,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:30.171202+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:47:30.171202+0000","last_peered":"2023-09-23T08:47:30.171202+0000","last_clean":"2023-09-23T08:47:30.171202+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:47:30.171202+0000","last_undegraded":"2023-09-23T08:47:30.171202+0000","last_fullsized":"2023-09-23T08:47:30.171202+0000","mapping_epoch":13,"log_start":"88'324311","ondisk_log_start":"88'324311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3105481174,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":329155,"num_read_kb":1295932,"num_write":326892,"num_write_kb":1307448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'306097","reported_seq":608421,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:30.150475+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:47:30.150475+0000","last_peered":"2023-09-23T08:47:30.150475+0000","last_clean":"2023-09-23T08:47:30.150475+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:47:30.150475+0000","last_undegraded":"2023-09-23T08:47:30.150475+0000","last_fullsized":"2023-09-23T08:47:30.150475+0000","mapping_epoch":13,"log_start":"88'296008","ondisk_log_start":"88'296008","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2816229677,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":301049,"num_read_kb":1185309,"num_write":298649,"num_write_kb":1194509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'323771","reported_seq":635993,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:30.310712+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:47:30.310712+0000","last_peered":"2023-09-23T08:47:30.310712+0000","last_clean":"2023-09-23T08:47:30.310712+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:47:30.310712+0000","last_undegraded":"2023-09-23T08:47:30.310712+0000","last_fullsized":"2023-09-23T08:47:30.310712+0000","mapping_epoch":13,"log_start":"88'313706","ondisk_log_start":"88'313706","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2889089558,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":311080,"num_read_kb":1224487,"num_write":307691,"num_write_kb":1230647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":269,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:49.733021+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:44:49.733021+0000","last_peered":"2023-09-23T08:44:49.733021+0000","last_clean":"2023-09-23T08:44:49.733021+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:44:49.733021+0000","last_undegraded":"2023-09-23T08:44:49.733021+0000","last_fullsized":"2023-09-23T08:44:49.733021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23812303659,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2539080,"num_read_kb":10001955,"num_write":2520294,"num_write_kb":10080201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10734,"num_omap_keys":208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19031949312,"data_stored":22966888022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80467,"ondisk_log_size":80467,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739459,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5042220,"kb_used_data":3442272,"kb_used_omap":335,"kb_used_meta":1599600,"kb_avail":89329620,"statfs":{"total":96636764160,"available":91473530880,"internally_reserved":0,"allocated":3524886528,"data_stored":4245502366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":343753,"internal_metadata":1637990711},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,1,2,9,3,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:46:41 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":0.92200000000000004,"15min":0.86699999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":4.5940000000000003,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":0.88300000000000001,"15min":0.79900000000000004},"min":{"1min":0.218,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":5.5119999999999996,"5min":7.492,"15min":14.997999999999999},"last":0.30099999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:46:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.173,"15min":1.1739999999999999},"min":{"1min":0.30099999999999999,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":4.5670000000000002,"5min":6.4960000000000004,"15min":10.759},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":1.1830000000000001,"15min":1.2749999999999999},"min":{"1min":0.23300000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":3.758,"5min":6.1799999999999997,"15min":12.379},"last":0.55500000000000005}]}]},{"osd":1,"up_from":8,"seq":34359739442,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11043960,"kb_used_data":9293552,"kb_used_omap":899,"kb_used_meta":1749500,"kb_avail":83327880,"statfs":{"total":96636764160,"available":85327749120,"internally_reserved":0,"allocated":9516597248,"data_stored":11484209616,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":1791488735},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,8,2,7,4,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:46:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79500000000000004,"15min":0.78200000000000003},"min":{"1min":0.219,"5min":0.20100000000000001,"15min":0.191},"max":{"1min":4.274,"5min":10.898,"15min":11.917},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.871,"5min":1.0589999999999999,"15min":1.1930000000000001},"min":{"1min":0.25800000000000001,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":5.3890000000000002,"5min":10.992000000000001,"15min":15.718},"last":0.246}]},{"osd":2,"last update":"Sat Sep 23 08:46:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.147,"15min":0.94999999999999996},"min":{"1min":0.23799999999999999,"5min":0.183,"15min":0.183},"max":{"1min":11.372,"5min":11.372,"15min":11.372},"last":4.077},{"interface":"front","average":{"1min":1.0820000000000001,"5min":0.84399999999999997,"15min":0.83499999999999996},"min":{"1min":0.28999999999999998,"5min":0.25700000000000001,"15min":0.24299999999999999},"max":{"1min":6.016,"5min":7.2370000000000001,"15min":7.8170000000000002},"last":4.1219999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739454,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7809376,"kb_used_data":5851092,"kb_used_omap":551,"kb_used_meta":1957720,"kb_avail":86562464,"statfs":{"total":96636764160,"available":88639963136,"internally_reserved":0,"allocated":5991518208,"data_stored":7238192311,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":2004705707},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,3,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:46:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0369999999999999,"15min":1.1220000000000001},"min":{"1min":0.20599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":6.5010000000000003,"5min":7.8689999999999998,"15min":17.216000000000001},"last":3.839},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.081,"15min":1.1970000000000001},"min":{"1min":0.36099999999999999,"5min":0.224,"15min":0.224},"max":{"1min":6.5330000000000004,"5min":7.944,"15min":17.251000000000001},"last":3.8769999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.083,"15min":0.85399999999999998},"min":{"1min":0.20300000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":9.1069999999999993,"5min":9.1069999999999993,"15min":9.1069999999999993},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.76100000000000001,"15min":0.58699999999999997},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.22800000000000001},"max":{"1min":4.2729999999999997,"5min":7.641,"15min":7.641},"last":0.30399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5991272448,"data_stored":7237772818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9516429312,"data_stored":11483835179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3524247552,"data_stored":4245280025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:47:33.152 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:47:33.152 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:47:33.152 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:47:33.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:33.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:33.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:33.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:33.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:33.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:33.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:33.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:33.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:33.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:33.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:33.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:33.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:33.658+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:33.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:33.670+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:34.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:34.404 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.398+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:34.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:34.415 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.406+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:34.456 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:34.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:34.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:34.509 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.498+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:34.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:34.534 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:34.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:34.534+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:35.490 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:35.482+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:35.495 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:35.486+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:35.501 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:35.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:35.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:35.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:35.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:35.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:35.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:35.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:35.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:35.562+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:37.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:37.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.146+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:37.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.150+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:37.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:37.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.170+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:37.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.186+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:37.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:37.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.218+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:37.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.226+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:37.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:37.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.262+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:37.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:37.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.494+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:37.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.502+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:37.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:37.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:37.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:37.533 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.526+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:37.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:37.558 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:37.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:38.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.546+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:38.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.550+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:38.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.622+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:38.656 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.650+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:38.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.678+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:38.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.698+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:38.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:38.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:38.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:38.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.722+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:38.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.742+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:38.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:38.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:38.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:38.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:38.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.974+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:38.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:38.982+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:39.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:39.030+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:39.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:39.038+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:39.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:39.046+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:39.083 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:39.074+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:40.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:40.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:40.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:40.454+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:40.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:40.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:40.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:40.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:40.582 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:40.570+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:40.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:40.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:40.605 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:40.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:40.606 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:40.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:40.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:40.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:40.649 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:40.642+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:41.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.410+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:41.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:41.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.418+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:41.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.450+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:41.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:41.515 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:41.516 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.514+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:41.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.530+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:41.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.542+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:41.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.566+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:41.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:41.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.586+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:41.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:41.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:41.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:41.601 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:41.602 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.598+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:41.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.754+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:41.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.758+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:41.803 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:41.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:41.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.842+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:41.852 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.846+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:41.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.874+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:41.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:41.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:41.917 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:41.910+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:44.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:44.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:44.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:44.690+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:44.707 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:44.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:44.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:44.706+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:44.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:44.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:44.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:44.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:44.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:44.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:44.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:44.790+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:45.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:45.382+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:45.442 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:45.434+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:45.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:45.474+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:45.513 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:45.510+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:45.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:45.522+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:45.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:45.554+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:45.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:45.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:45.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:45.574+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:45.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:45.590+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:45.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:45.602+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:46.611 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.610+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:46.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:46.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.614+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:46.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:46.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:46.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:46.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.634+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:46.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:46.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:46.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:46.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:46.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.702+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:46.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:46.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:47.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:47.078+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:47.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:47.130+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:47.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:47.166+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:47.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:47.190+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:47.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:47.206+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:47.213 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:47.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:47.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:47.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:47.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:47.246+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:47.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:47.250+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:47.796 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:47.794+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:47:47.796 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:47.794+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:47:49.050 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:47:49.046+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:47:49.051 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:47:49.046+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:47:49.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.618+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:49.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.626+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:49.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.630+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:49.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.662+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:49.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.686+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:49.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.694+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:49.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.710+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:49.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.726+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:49.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.734+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:49.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.746+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:49.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.750+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:49.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:49.767 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.762+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:49.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.766+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:49.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:49.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:49.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.786+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:49.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:49.802+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:50.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.274+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:50.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.302+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:50.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.310+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:50.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:50.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.314+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:50.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.318+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:50.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.322+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:50.339 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.338+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:50.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.358+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:50.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.370+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:50.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:50.374+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:51.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:47:51.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.154+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:51.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.162+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:51.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:51.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.194+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:51.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:51.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.202+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:51.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:51.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:51.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:51.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:51.215 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.210+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:51.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:51.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.902+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:51.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:51.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.942+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:51.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:51.978+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:52.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:52.834+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:52.872 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:52.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:52.873 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:52.870+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:52.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:52.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:52.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:52.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:52.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:52.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:52.883 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:52.878+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:52.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:52.890+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:53.154 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:47:53.445 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:53.438+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:47:53.445 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:53.438+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:47:53.445 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:53.438+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:47:54.104 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:47:54.104 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:47:54.164 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2821,"stamp":"2023-09-23T08:47:52.694282+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23828733259,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2546880,"num_read_kb":10032770,"num_write":2528323,"num_write_kb":10113663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80421,"ondisk_log_size":80421,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23890784,"kb_used_data":18622152,"kb_used_omap":1786,"kb_used_meta":5266821,"kb_avail":259224736,"statfs":{"total":289910292480,"available":265446129664,"internally_reserved":0,"allocated":19069083648,"data_stored":22998468645,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1829439,"internal_metadata":5393225153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,6,6,14,11,10,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10457088,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5080,"num_read_kb":20276,"num_write":5246,"num_write_kb":20984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1524,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009674"},"pg_stats":[{"pgid":"2.7","version":"88'314155","reported_seq":616845,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:51.114537+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:47:51.114537+0000","last_peered":"2023-09-23T08:47:51.114537+0000","last_clean":"2023-09-23T08:47:51.114537+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:47:51.114537+0000","last_undegraded":"2023-09-23T08:47:51.114537+0000","last_fullsized":"2023-09-23T08:47:51.114537+0000","mapping_epoch":13,"log_start":"88'304111","ondisk_log_start":"88'304111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2808754511,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":301459,"num_read_kb":1187598,"num_write":298048,"num_write_kb":1192096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'346057","reported_seq":679839,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:47:51.107730+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:47:51.107730+0000","last_peered":"2023-09-23T08:47:51.107730+0000","last_clean":"2023-09-23T08:47:51.107730+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:47:51.107730+0000","last_undegraded":"2023-09-23T08:47:51.107730+0000","last_fullsized":"2023-09-23T08:47:51.107730+0000","mapping_epoch":13,"log_start":"88'336008","ondisk_log_start":"88'336008","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1146,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 619s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3137974591,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":333317,"num_read_kb":1308998,"num_write":330076,"num_write_kb":1320073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'327695","reported_seq":641916,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:51.055111+0000","last_change":"2023-09-23T08:47:37.029341+0000","last_active":"2023-09-23T08:47:51.055111+0000","last_peered":"2023-09-23T08:47:51.055111+0000","last_clean":"2023-09-23T08:47:51.055111+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:47:51.055111+0000","last_undegraded":"2023-09-23T08:47:51.055111+0000","last_fullsized":"2023-09-23T08:47:51.055111+0000","mapping_epoch":13,"log_start":"88'317611","ondisk_log_start":"88'317611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'326949","last_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_deep_scrub":"88'326949","last_deep_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_clean_scrub_stamp":"2023-09-23T08:47:37.029020+0000","objects_scrubbed":1230,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:11:05.589408+0000","scrub_duration":554.13017261499999,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2921521452,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":312948,"num_read_kb":1232785,"num_write":311629,"num_write_kb":1246429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1524,"num_omap_keys":30,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'333053","reported_seq":665476,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:51.073171+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:47:51.073171+0000","last_peered":"2023-09-23T08:47:51.073171+0000","last_clean":"2023-09-23T08:47:51.073171+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:47:51.073171+0000","last_undegraded":"2023-09-23T08:47:51.073171+0000","last_fullsized":"2023-09-23T08:47:51.073171+0000","mapping_epoch":13,"log_start":"88'323012","ondisk_log_start":"88'323012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3126100250,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":332801,"num_read_kb":1317019,"num_write":331430,"num_write_kb":1325633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'324543","reported_seq":647273,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:49.010943+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:47:49.010943+0000","last_peered":"2023-09-23T08:47:49.010943+0000","last_clean":"2023-09-23T08:47:49.010943+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:47:49.010943+0000","last_undegraded":"2023-09-23T08:47:49.010943+0000","last_fullsized":"2023-09-23T08:47:49.010943+0000","mapping_epoch":13,"log_start":"88'314509","ondisk_log_start":"88'314509","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3017187646,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":322120,"num_read_kb":1269195,"num_write":320847,"num_write_kb":1283238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'335416","reported_seq":666761,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:50.226553+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:47:50.226553+0000","last_peered":"2023-09-23T08:47:50.226553+0000","last_clean":"2023-09-23T08:47:50.226553+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:47:50.226553+0000","last_undegraded":"2023-09-23T08:47:50.226553+0000","last_fullsized":"2023-09-23T08:47:50.226553+0000","mapping_epoch":13,"log_start":"88'325411","ondisk_log_start":"88'325411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3107463638,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":330125,"num_read_kb":1299804,"num_write":327896,"num_write_kb":1311464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'307039","reported_seq":610265,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:50.214959+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:47:50.214959+0000","last_peered":"2023-09-23T08:47:50.214959+0000","last_clean":"2023-09-23T08:47:50.214959+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:47:50.214959+0000","last_undegraded":"2023-09-23T08:47:50.214959+0000","last_fullsized":"2023-09-23T08:47:50.214959+0000","mapping_epoch":13,"log_start":"88'297008","ondisk_log_start":"88'297008","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2818068781,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":301940,"num_read_kb":1188869,"num_write":299573,"num_write_kb":1198205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'324840","reported_seq":638055,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:47:51.043193+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:47:51.043193+0000","last_peered":"2023-09-23T08:47:51.043193+0000","last_clean":"2023-09-23T08:47:51.043193+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:47:51.043193+0000","last_undegraded":"2023-09-23T08:47:51.043193+0000","last_fullsized":"2023-09-23T08:47:51.043193+0000","mapping_epoch":13,"log_start":"88'314806","ondisk_log_start":"88'314806","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2891072022,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":312064,"num_read_kb":1228411,"num_write":308687,"num_write_kb":1234631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":269,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:49.733021+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:44:49.733021+0000","last_peered":"2023-09-23T08:44:49.733021+0000","last_clean":"2023-09-23T08:44:49.733021+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:44:49.733021+0000","last_undegraded":"2023-09-23T08:44:49.733021+0000","last_fullsized":"2023-09-23T08:44:49.733021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23828142891,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2546774,"num_read_kb":10032679,"num_write":2528186,"num_write_kb":10111769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19068088320,"data_stored":22997497430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80322,"ondisk_log_size":80322,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739463,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5092344,"kb_used_data":3448688,"kb_used_omap":335,"kb_used_meta":1643312,"kb_avail":89279496,"statfs":{"total":96636764160,"available":91422203904,"internally_reserved":0,"allocated":3531456512,"data_stored":4251056542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":343753,"internal_metadata":1682751799},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,3,2,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:47:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.91500000000000004,"15min":0.84499999999999997},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.2210000000000001,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.90800000000000003,"15min":0.80500000000000005},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.8340000000000001,"5min":7.492,"15min":14.997999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:47:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":1.175,"15min":1.1160000000000001},"min":{"1min":0.26700000000000002,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":2.8679999999999999,"5min":6.4960000000000004,"15min":10.759},"last":0.38},{"interface":"front","average":{"1min":1.597,"5min":1.343,"15min":1.258},"min":{"1min":0.22500000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":9.6850000000000005,"5min":9.6850000000000005,"15min":12.379},"last":4.4260000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739446,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11226068,"kb_used_data":9311052,"kb_used_omap":899,"kb_used_meta":1914108,"kb_avail":83145772,"statfs":{"total":96636764160,"available":85141270528,"internally_reserved":0,"allocated":9534517248,"data_stored":11499381200,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":1960047327},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,5,11,7,8,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:47:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.88700000000000001,"15min":0.78400000000000003},"min":{"1min":0.23799999999999999,"5min":0.214,"15min":0.191},"max":{"1min":4.3760000000000003,"5min":10.898,"15min":11.917},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.88600000000000001,"15min":1.1519999999999999},"min":{"1min":0.214,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":0.82799999999999996,"5min":10.992000000000001,"15min":15.718},"last":0.20899999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:47:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.3720000000000001,"15min":0.97799999999999998},"min":{"1min":0.28599999999999998,"5min":0.183,"15min":0.183},"max":{"1min":12.102,"5min":12.102,"15min":12.102},"last":0.26300000000000001},{"interface":"front","average":{"1min":2.1880000000000002,"5min":1.204,"15min":0.94499999999999995},"min":{"1min":0.27300000000000002,"5min":0.25700000000000001,"15min":0.24299999999999999},"max":{"1min":12.148999999999999,"5min":12.148999999999999,"15min":12.148999999999999},"last":4.4930000000000003}]}]},{"osd":0,"up_from":8,"seq":34359739458,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7572372,"kb_used_data":5862412,"kb_used_omap":551,"kb_used_meta":1709400,"kb_avail":86799468,"statfs":{"total":96636764160,"available":88882655232,"internally_reserved":0,"allocated":6003109888,"data_stored":7248030903,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1750426027},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:47:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.1619999999999999,"15min":1.141},"min":{"1min":0.17100000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":5.1429999999999998,"5min":7.8689999999999998,"15min":17.216000000000001},"last":2.4620000000000002},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.2110000000000001,"15min":1.2170000000000001},"min":{"1min":0.32600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":5.1870000000000003,"5min":7.944,"15min":17.251000000000001},"last":2.4969999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.083,"15min":0.85399999999999998},"min":{"1min":0.20300000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":9.1069999999999993,"5min":9.1069999999999993,"15min":9.1069999999999993},"last":0.218},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.76100000000000001,"15min":0.58699999999999997},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.22800000000000001},"max":{"1min":4.2729999999999997,"5min":7.641,"15min":7.641},"last":0.27000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6002446336,"data_stored":7247246866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9534812160,"data_stored":11499399979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3530829824,"data_stored":4250850585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:47:54.166 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:47:54.166 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:47:54.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:54.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:54.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:54.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:54.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:54.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:54.936 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:54.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:54.948 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:54.945+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:54.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:54.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:54.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:54.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:54.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:54.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:54.993 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:54.989+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:54.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:54.993+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:55.406 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:55.401+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:47:55.407 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:55.401+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:47:55.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:55.797+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:55.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:55.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:55.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:55.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:55.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:55.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:55.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:55.825+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:55.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:55.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:55.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:55.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:55.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:55.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:55.909 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:55.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:55.922 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:55.913+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:56.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:56.809+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:56.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:56.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:56.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:56.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:56.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:56.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:56.876 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:56.873+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:56.901 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:56.897+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:56.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:56.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:56.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:56.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:59.087 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:59.081+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:47:59.087 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:59.081+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:47:59.089 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:59.085+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:47:59.089 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:59.085+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:47:59.090 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:47:59.085+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:47:59.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:59.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:59.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.193+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:47:59.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:59.247 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:59.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:59.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:59.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:47:59.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:47:59.321 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:47:59.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.353+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:47:59.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:47:59.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:47:59.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:47:59.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:47:59.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.949+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:47:59.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:47:59.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:47:59.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:00.003 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:00.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:00.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:00.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:00.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:00.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:01.407 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:01.405+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:48:01.408 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:01.405+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:48:01.408 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:01.405+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:48:03.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:03.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:03.240 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:03.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:03.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:03.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:03.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:03.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:03.264 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.261+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:03.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:03.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:03.438 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:03.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:03.457 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:03.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:03.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:03.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:03.458 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:03.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:03.457+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:05.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:05.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.513+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:05.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:05.572 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:05.584 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.581+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:05.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:05.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:05.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:05.629 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:05.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.621+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:05.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:05.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:07.694 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:07.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:07.709 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:07.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:07.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:07.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:07.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:07.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:07.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:07.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:07.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:07.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:07.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:07.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:07.738 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:07.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:07.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:07.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:07.959 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:07.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:08.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:08.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:08.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:08.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:08.030 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:08.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:08.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:08.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:08.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:08.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:08.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:08.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:08.102 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:08.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:08.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:08.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:08.608 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:08.601+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:48:09.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.557+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:09.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:09.575 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.565+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:09.593 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.589+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:09.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:09.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:09.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:09.877 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:09.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:09.911 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.909+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:09.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:09.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:09.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:09.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:09.981+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:10.214 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:10.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:10.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.249+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:10.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:10.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:10.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:10.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.269+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:10.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:10.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:10.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.741+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:10.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:10.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:10.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:10.789 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:10.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:10.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:10.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:10.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.837+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:10.897 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:10.893+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:11.298 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:11.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.321+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:11.389 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:11.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:11.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.397+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:11.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:11.425 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:11.434 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.429+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:11.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.441+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:11.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.477+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:11.496 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:11.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:11.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:11.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:11.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:11.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:11.509+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:13.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:13.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:13.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:13.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:13.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:13.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:13.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:13.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:13.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:13.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:13.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:13.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:13.383 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:13.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:13.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:13.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:13.384 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:13.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:14.167 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:48:14.835 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:48:14.836 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:48:14.891 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2832,"stamp":"2023-09-23T08:48:14.697766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23845264715,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2554484,"num_read_kb":10063154,"num_write":2536630,"num_write_kb":10146891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80419,"ondisk_log_size":80419,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24255520,"kb_used_data":18661508,"kb_used_omap":1786,"kb_used_meta":5592197,"kb_avail":258860000,"statfs":{"total":289910292480,"available":265072640000,"internally_reserved":0,"allocated":19109384192,"data_stored":23032580133,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1829439,"internal_metadata":5726410177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,6,8,11,23,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8540160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3896,"num_read_kb":15572,"num_write":4306,"num_write_kb":17224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001859"},"pg_stats":[{"pgid":"2.7","version":"88'315082","reported_seq":618701,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:11.741177+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:48:11.741177+0000","last_peered":"2023-09-23T08:48:11.741177+0000","last_clean":"2023-09-23T08:48:11.741177+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:48:11.741177+0000","last_undegraded":"2023-09-23T08:48:11.741177+0000","last_fullsized":"2023-09-23T08:48:11.741177+0000","mapping_epoch":13,"log_start":"88'305011","ondisk_log_start":"88'305011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2810507599,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":302381,"num_read_kb":1191286,"num_write":298924,"num_write_kb":1195600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'347196","reported_seq":681920,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:48:11.752610+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:48:11.752610+0000","last_peered":"2023-09-23T08:48:11.752610+0000","last_clean":"2023-09-23T08:48:11.752610+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:48:11.752610+0000","last_undegraded":"2023-09-23T08:48:11.752610+0000","last_fullsized":"2023-09-23T08:48:11.752610+0000","mapping_epoch":13,"log_start":"88'337108","ondisk_log_start":"88'337108","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1180,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 640s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3140190527,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":334247,"num_read_kb":1312718,"num_write":331137,"num_write_kb":1324317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'328737","reported_seq":643865,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:11.665089+0000","last_change":"2023-09-23T08:47:37.029341+0000","last_active":"2023-09-23T08:48:11.665089+0000","last_peered":"2023-09-23T08:48:11.665089+0000","last_clean":"2023-09-23T08:48:11.665089+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:48:11.665089+0000","last_undegraded":"2023-09-23T08:48:11.665089+0000","last_fullsized":"2023-09-23T08:48:11.665089+0000","mapping_epoch":13,"log_start":"88'318711","ondisk_log_start":"88'318711","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'326949","last_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_deep_scrub":"88'326949","last_deep_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_clean_scrub_stamp":"2023-09-23T08:47:37.029020+0000","objects_scrubbed":1230,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:11:05.589408+0000","scrub_duration":554.13017261499999,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2923340076,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":313848,"num_read_kb":1236385,"num_write":312614,"num_write_kb":1250369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1524,"num_omap_keys":30,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'334116","reported_seq":667520,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:11.634752+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:48:11.634752+0000","last_peered":"2023-09-23T08:48:11.634752+0000","last_clean":"2023-09-23T08:48:11.634752+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:48:11.634752+0000","last_undegraded":"2023-09-23T08:48:11.634752+0000","last_fullsized":"2023-09-23T08:48:11.634752+0000","mapping_epoch":13,"log_start":"88'324112","ondisk_log_start":"88'324112","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3128238362,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":333779,"num_read_kb":1320927,"num_write":332493,"num_write_kb":1329885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'325824","reported_seq":649720,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:14.213886+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:48:14.213886+0000","last_peered":"2023-09-23T08:48:14.213886+0000","last_clean":"2023-09-23T08:48:14.213886+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:48:14.213886+0000","last_undegraded":"2023-09-23T08:48:14.213886+0000","last_fullsized":"2023-09-23T08:48:14.213886+0000","mapping_epoch":13,"log_start":"88'315809","ondisk_log_start":"88'315809","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3019739454,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":323279,"num_read_kb":1273823,"num_write":322122,"num_write_kb":1288338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'336528","reported_seq":668826,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:10.358998+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:48:10.358998+0000","last_peered":"2023-09-23T08:48:10.358998+0000","last_clean":"2023-09-23T08:48:10.358998+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:48:10.358998+0000","last_undegraded":"2023-09-23T08:48:10.358998+0000","last_fullsized":"2023-09-23T08:48:10.358998+0000","mapping_epoch":13,"log_start":"88'326511","ondisk_log_start":"88'326511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3109700054,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":331071,"num_read_kb":1303580,"num_write":328987,"num_write_kb":1315828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'308009","reported_seq":612124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:10.323949+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:48:10.323949+0000","last_peered":"2023-09-23T08:48:10.323949+0000","last_clean":"2023-09-23T08:48:10.323949+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:48:10.323949+0000","last_undegraded":"2023-09-23T08:48:10.323949+0000","last_fullsized":"2023-09-23T08:48:10.323949+0000","mapping_epoch":13,"log_start":"88'298008","ondisk_log_start":"88'298008","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2819862829,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":302818,"num_read_kb":1192377,"num_write":300522,"num_write_kb":1202001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'325904","reported_seq":640019,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:11.679568+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:48:11.679568+0000","last_peered":"2023-09-23T08:48:11.679568+0000","last_clean":"2023-09-23T08:48:11.679568+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:48:11.679568+0000","last_undegraded":"2023-09-23T08:48:11.679568+0000","last_fullsized":"2023-09-23T08:48:11.679568+0000","mapping_epoch":13,"log_start":"88'315806","ondisk_log_start":"88'315806","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2893095446,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":312955,"num_read_kb":1231967,"num_write":309694,"num_write_kb":1238659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":269,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:49.733021+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:44:49.733021+0000","last_peered":"2023-09-23T08:44:49.733021+0000","last_clean":"2023-09-23T08:44:49.733021+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:44:49.733021+0000","last_undegraded":"2023-09-23T08:44:49.733021+0000","last_fullsized":"2023-09-23T08:44:49.733021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23844674347,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2554378,"num_read_kb":10063063,"num_write":2536493,"num_write_kb":10144997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19107946496,"data_stored":23031248470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80320,"ondisk_log_size":80320,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739467,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5167160,"kb_used_data":3455472,"kb_used_omap":335,"kb_used_meta":1711344,"kb_avail":89204680,"statfs":{"total":96636764160,"available":91345592320,"internally_reserved":0,"allocated":3538403328,"data_stored":4256987550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":343753,"internal_metadata":1752416567},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,0,4,6,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:47:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.91500000000000004,"15min":0.84499999999999997},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.2210000000000001,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.90800000000000003,"15min":0.80500000000000005},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.8340000000000001,"5min":7.492,"15min":14.997999999999999},"last":0.26200000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:47:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":1.175,"15min":1.1160000000000001},"min":{"1min":0.26700000000000002,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":2.8679999999999999,"5min":6.4960000000000004,"15min":10.759},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.597,"5min":1.343,"15min":1.258},"min":{"1min":0.22500000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":9.6850000000000005,"5min":9.6850000000000005,"15min":12.379},"last":0.59999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739450,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11362980,"kb_used_data":9329948,"kb_used_omap":899,"kb_used_meta":2032124,"kb_avail":83008860,"statfs":{"total":96636764160,"available":85001072640,"internally_reserved":0,"allocated":9553866752,"data_stored":11515732432,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":2080895711},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5,6,6,13,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:47:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.88700000000000001,"15min":0.78400000000000003},"min":{"1min":0.23799999999999999,"5min":0.214,"15min":0.191},"max":{"1min":4.3760000000000003,"5min":10.898,"15min":11.917},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.88600000000000001,"15min":1.1519999999999999},"min":{"1min":0.214,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":0.82799999999999996,"5min":10.992000000000001,"15min":15.718},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:47:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.3720000000000001,"15min":0.97799999999999998},"min":{"1min":0.28599999999999998,"5min":0.183,"15min":0.183},"max":{"1min":12.102,"5min":12.102,"15min":12.102},"last":0.36299999999999999},{"interface":"front","average":{"1min":2.1880000000000002,"5min":1.204,"15min":0.94499999999999995},"min":{"1min":0.27300000000000002,"5min":0.25700000000000001,"15min":0.24299999999999999},"max":{"1min":12.148999999999999,"5min":12.148999999999999,"15min":12.148999999999999},"last":0.28599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739463,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7725380,"kb_used_data":5876088,"kb_used_omap":551,"kb_used_meta":1848728,"kb_avail":86646460,"statfs":{"total":96636764160,"available":88725975040,"internally_reserved":0,"allocated":6017114112,"data_stored":7259860151,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1893097899},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,1,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:47:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.1619999999999999,"15min":1.141},"min":{"1min":0.17100000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":5.1429999999999998,"5min":7.8689999999999998,"15min":17.216000000000001},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.2110000000000001,"15min":1.2170000000000001},"min":{"1min":0.32600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":5.1870000000000003,"5min":7.944,"15min":17.251000000000001},"last":1.661}]},{"osd":2,"last update":"Sat Sep 23 08:47:19 2023","interfaces":[{"interface":"back","average":{"1min":1.887,"5min":1.083,"15min":0.85399999999999998},"min":{"1min":0.20300000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":9.1069999999999993,"5min":9.1069999999999993,"15min":9.1069999999999993},"last":0.313},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.76100000000000001,"15min":0.58699999999999997},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.22800000000000001},"max":{"1min":4.2729999999999997,"5min":7.641,"15min":7.641},"last":0.33900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6016729088,"data_stored":7259321874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9553448960,"data_stored":11515161387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3537768448,"data_stored":4256765209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:48:14.893 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:48:14.893 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:48:16.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:16.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:16.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.189+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:16.202 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:16.197+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:48:16.202 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:16.197+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:48:16.203 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:16.197+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:48:16.245 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:16.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.253+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:16.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:16.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:16.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.293+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:48:16.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:16.344 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:16.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:16.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:16.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:16.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:16.699 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:16.701 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.697+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:16.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:16.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:16.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:16.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:16.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:16.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:16.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:17.592 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:17.589+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:48:17.616 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:17.613+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:48:17.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:17.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:17.647 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:17.645+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:48:17.647 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:17.645+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:48:17.651 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:17.649+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:48:17.661 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:17.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:17.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:17.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:17.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:17.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:17.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:17.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:17.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:17.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:17.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:17.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:17.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:17.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:17.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:17.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:18.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:18.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:18.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:18.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:18.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:18.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:18.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:18.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:18.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:18.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:18.073 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:18.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:18.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:18.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:18.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:18.097+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:19.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:19.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:19.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:19.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:19.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:19.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:19.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:19.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:19.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:19.489+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:19.504 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:19.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:19.508 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:19.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:19.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:19.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:19.530 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:19.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:19.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:19.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:20.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:20.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:20.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:20.789+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:20.860 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:20.849+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:20.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:20.861+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:20.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:20.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:20.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:20.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:20.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:20.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:20.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:20.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:20.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:20.941+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:22.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:22.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:22.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:22.917+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:22.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:22.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:22.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:22.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:22.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:22.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:26.135 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:26.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:26.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:26.188 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:26.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:26.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.237+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:26.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:26.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:26.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:26.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:26.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.933+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:26.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:26.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:27.008 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:27.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:27.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:27.051 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.049+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:27.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:27.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.053+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:27.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:48:27.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:27.268 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:27.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:27.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:27.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:27.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:27.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:27.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:27.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:27.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:27.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:27.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:27.609 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.605+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:27.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:27.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.637+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:27.667 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:27.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:27.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:27.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:27.705 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:27.701+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:27.954 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:27.949+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:48:27.954 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:27.949+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:48:28.427 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:28.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.453+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:28.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:28.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:28.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.485+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:28.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.497+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:28.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:28.528 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.525+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:28.552 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:28.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:28.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:28.569+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:29.345 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:29.341+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:29.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:29.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:29.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:29.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:29.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:29.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:29.486 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:29.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:29.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:29.493+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:29.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:29.501+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:30.930 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:30.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:30.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:30.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:30.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:30.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:31.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:30.997+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:31.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:31.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:32.846 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:32.841+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:32.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:32.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:32.863 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:32.857+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:32.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:32.869+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:32.888 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:32.885+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:32.907 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:32.901+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:32.910 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:32.905+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:33.128 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.125+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:33.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.133+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:33.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:33.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:33.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:33.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:33.166 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:33.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:33.598 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.593+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:33.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:33.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:33.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.661+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:33.697 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.693+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:33.720 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:33.768 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.765+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:33.839 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:33.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:33.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:33.845+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:34.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:34.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:34.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:34.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:34.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:34.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.285+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:34.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:34.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:34.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:34.722 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:34.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:34.737 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.733+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:34.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.805+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:34.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:34.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.829+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:34.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:34.833+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:34.894 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:48:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:48:35.500 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:48:35.574 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2842,"stamp":"2023-09-23T08:48:34.705423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23861001547,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2562207,"num_read_kb":10094038,"num_write":2544559,"num_write_kb":10178607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80511,"ondisk_log_size":80511,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24598424,"kb_used_data":18696500,"kb_used_omap":1786,"kb_used_meta":5900101,"kb_avail":258517096,"statfs":{"total":289910292480,"available":264721506304,"internally_reserved":0,"allocated":19145216000,"data_stored":23062755365,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1829439,"internal_metadata":6041703873},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,8,7,14,15,11,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8286208,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4306,"num_read_kb":17224,"num_write":4220,"num_write_kb":16880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006354"},"pg_stats":[{"pgid":"2.7","version":"88'316036","reported_seq":620562,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:32.293706+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:48:32.293706+0000","last_peered":"2023-09-23T08:48:32.293706+0000","last_clean":"2023-09-23T08:48:32.293706+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:48:32.293706+0000","last_undegraded":"2023-09-23T08:48:32.293706+0000","last_fullsized":"2023-09-23T08:48:32.293706+0000","mapping_epoch":13,"log_start":"88'306011","ondisk_log_start":"88'306011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2812289359,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":303276,"num_read_kb":1194866,"num_write":299830,"num_write_kb":1199224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'348302","reported_seq":684000,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:48:32.310718+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:48:32.310718+0000","last_peered":"2023-09-23T08:48:32.310718+0000","last_clean":"2023-09-23T08:48:32.310718+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:48:32.310718+0000","last_undegraded":"2023-09-23T08:48:32.310718+0000","last_fullsized":"2023-09-23T08:48:32.310718+0000","mapping_epoch":13,"log_start":"88'338208","ondisk_log_start":"88'338208","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1235,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 661s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3142447423,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":335202,"num_read_kb":1316534,"num_write":332162,"num_write_kb":1328417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'329762","reported_seq":645867,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:32.306541+0000","last_change":"2023-09-23T08:47:37.029341+0000","last_active":"2023-09-23T08:48:32.306541+0000","last_peered":"2023-09-23T08:48:32.306541+0000","last_clean":"2023-09-23T08:48:32.306541+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:48:32.306541+0000","last_undegraded":"2023-09-23T08:48:32.306541+0000","last_fullsized":"2023-09-23T08:48:32.306541+0000","mapping_epoch":13,"log_start":"88'319711","ondisk_log_start":"88'319711","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'326949","last_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_deep_scrub":"88'326949","last_deep_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_clean_scrub_stamp":"2023-09-23T08:47:37.029020+0000","objects_scrubbed":1230,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:11:05.589408+0000","scrub_duration":554.13017261499999,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2925228332,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":314813,"num_read_kb":1240245,"num_write":313592,"num_write_kb":1254281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1524,"num_omap_keys":30,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'335243","reported_seq":669672,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:32.315707+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:48:32.315707+0000","last_peered":"2023-09-23T08:48:32.315707+0000","last_clean":"2023-09-23T08:48:32.315707+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:48:32.315707+0000","last_undegraded":"2023-09-23T08:48:32.315707+0000","last_fullsized":"2023-09-23T08:48:32.315707+0000","mapping_epoch":13,"log_start":"88'325212","ondisk_log_start":"88'325212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3130401050,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":334805,"num_read_kb":1325031,"num_write":333620,"num_write_kb":1334393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'326863","reported_seq":651759,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:34.440597+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:48:34.440597+0000","last_peered":"2023-09-23T08:48:34.440597+0000","last_clean":"2023-09-23T08:48:34.440597+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:48:34.440597+0000","last_undegraded":"2023-09-23T08:48:34.440597+0000","last_fullsized":"2023-09-23T08:48:34.440597+0000","mapping_epoch":13,"log_start":"88'316809","ondisk_log_start":"88'316809","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3021816126,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":324267,"num_read_kb":1277775,"num_write":323159,"num_write_kb":1292486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'337564","reported_seq":670865,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:30.392506+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:48:30.392506+0000","last_peered":"2023-09-23T08:48:30.392506+0000","last_clean":"2023-09-23T08:48:30.392506+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:48:30.392506+0000","last_undegraded":"2023-09-23T08:48:30.392506+0000","last_fullsized":"2023-09-23T08:48:30.392506+0000","mapping_epoch":13,"log_start":"88'327511","ondisk_log_start":"88'327511","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3111702998,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":332060,"num_read_kb":1307536,"num_write":330004,"num_write_kb":1319896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'308918","reported_seq":613972,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:30.402032+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:48:30.402032+0000","last_peered":"2023-09-23T08:48:30.402032+0000","last_clean":"2023-09-23T08:48:30.402032+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:48:30.402032+0000","last_undegraded":"2023-09-23T08:48:30.402032+0000","last_fullsized":"2023-09-23T08:48:30.402032+0000","mapping_epoch":13,"log_start":"88'298908","ondisk_log_start":"88'298908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2821636397,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":303747,"num_read_kb":1196089,"num_write":301410,"num_write_kb":1205553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'326900","reported_seq":642006,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:32.287558+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:48:32.287558+0000","last_peered":"2023-09-23T08:48:32.287558+0000","last_clean":"2023-09-23T08:48:32.287558+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:48:32.287558+0000","last_undegraded":"2023-09-23T08:48:32.287558+0000","last_fullsized":"2023-09-23T08:48:32.287558+0000","mapping_epoch":13,"log_start":"88'316806","ondisk_log_start":"88'316806","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2894889494,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":313931,"num_read_kb":1235871,"num_write":310645,"num_write_kb":1242463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":269,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:49.733021+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:44:49.733021+0000","last_peered":"2023-09-23T08:44:49.733021+0000","last_clean":"2023-09-23T08:44:49.733021+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:44:49.733021+0000","last_undegraded":"2023-09-23T08:44:49.733021+0000","last_fullsized":"2023-09-23T08:44:49.733021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23860411179,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2562101,"num_read_kb":10093947,"num_write":2544422,"num_write_kb":10176713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19144208384,"data_stored":23061775958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80412,"ondisk_log_size":80412,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739471,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5228160,"kb_used_data":3461876,"kb_used_omap":335,"kb_used_meta":1765936,"kb_avail":89143680,"statfs":{"total":96636764160,"available":91283128320,"internally_reserved":0,"allocated":3544961024,"data_stored":4262467998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":343753,"internal_metadata":1808318775},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,0,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:47:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.91500000000000004,"15min":0.84499999999999997},"min":{"1min":0.14399999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.2210000000000001,"5min":7.6130000000000004,"15min":7.7039999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.90800000000000003,"15min":0.80500000000000005},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.8340000000000001,"5min":7.492,"15min":14.997999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Sat Sep 23 08:47:41 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":1.175,"15min":1.1160000000000001},"min":{"1min":0.26700000000000002,"5min":0.247,"15min":0.21199999999999999},"max":{"1min":2.8679999999999999,"5min":6.4960000000000004,"15min":10.759},"last":2.464},{"interface":"front","average":{"1min":1.597,"5min":1.343,"15min":1.258},"min":{"1min":0.22500000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":9.6850000000000005,"5min":9.6850000000000005,"15min":12.379},"last":2.7509999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739454,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11534948,"kb_used_data":9347612,"kb_used_omap":899,"kb_used_meta":2186428,"kb_avail":82836892,"statfs":{"total":96636764160,"available":84824977408,"internally_reserved":0,"allocated":9571954688,"data_stored":11530990032,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":2238903007},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,6,5,10,10,8,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:47:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.88700000000000001,"15min":0.78400000000000003},"min":{"1min":0.23799999999999999,"5min":0.214,"15min":0.191},"max":{"1min":4.3760000000000003,"5min":10.898,"15min":11.917},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.88600000000000001,"15min":1.1519999999999999},"min":{"1min":0.214,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":0.82799999999999996,"5min":10.992000000000001,"15min":15.718},"last":0.43099999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:47:35 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.3720000000000001,"15min":0.97799999999999998},"min":{"1min":0.28599999999999998,"5min":0.183,"15min":0.183},"max":{"1min":12.102,"5min":12.102,"15min":12.102},"last":3.3450000000000002},{"interface":"front","average":{"1min":2.1880000000000002,"5min":1.204,"15min":0.94499999999999995},"min":{"1min":0.27300000000000002,"5min":0.25700000000000001,"15min":0.24299999999999999},"max":{"1min":12.148999999999999,"5min":12.148999999999999,"15min":12.148999999999999},"last":3.383}]}]},{"osd":0,"up_from":8,"seq":34359739467,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7835316,"kb_used_data":5887012,"kb_used_omap":551,"kb_used_meta":1947736,"kb_avail":86536524,"statfs":{"total":96636764160,"available":88613400576,"internally_reserved":0,"allocated":6028300288,"data_stored":7269297335,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1994482091},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,2,4,3,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:47:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.1619999999999999,"15min":1.141},"min":{"1min":0.17100000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":5.1429999999999998,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.2110000000000001,"15min":1.2170000000000001},"min":{"1min":0.32600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":5.1870000000000003,"5min":7.944,"15min":17.251000000000001},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.1859999999999999,"15min":0.85299999999999998},"min":{"1min":0.20899999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":5.069,"5min":9.1069999999999993,"15min":9.1069999999999993},"last":10.763},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.746,"15min":0.58099999999999996},"min":{"1min":0.245,"5min":0.24199999999999999,"15min":0.22800000000000001},"max":{"1min":3.0369999999999999,"5min":7.641,"15min":7.641},"last":0.38200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6028087296,"data_stored":7268886034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9571831808,"data_stored":11530668843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3544289280,"data_stored":4262221081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:48:35.575 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:48:35.576 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:48:38.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:38.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:38.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:38.729+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:38.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:38.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:38.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:38.749+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:38.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:38.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:38.784 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:38.781+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:38.795 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:38.793+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:38.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:38.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:38.822 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:38.817+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:40.438 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:40.433+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:48:41.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:41.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:41.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:41.191 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.185+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:41.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.197+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:41.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.233+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:41.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:41.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:41.359 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:41.360 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:41.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.357+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:41.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:41.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:41.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:41.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:42.863 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:42.849+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:48:42.866 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:42.861+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:48:43.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.365+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:43.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.369+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:43.387 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.381+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:43.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:43.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:43.398 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.393+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:43.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.449+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:43.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:43.479 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.473+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:48:43.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.481+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:43.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.505+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:43.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.517+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:43.525 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:43.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.521+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:43.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.533+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:43.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.549+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:43.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.609+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:43.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:43.632 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:43.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.629+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:43.741 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.737+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:43.754 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:43.745+0000 7f3edd275640 -1 reset not still connected to 0x55a1df04a000 2023-09-23T08:48:43.754 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:43.745+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:48:43.754 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:43.745+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:48:43.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:43.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.773+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:43.788 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:43.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:43.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.785+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:43.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:43.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:44.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.013+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:44.024 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:44.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:44.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:44.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:44.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.069+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:44.078 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.073+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:44.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.137+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:44.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:44.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:44.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:44.408 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:44.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.437+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:44.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:44.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:44.475 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.469+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:44.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.641+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:44.687 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.685+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:44.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.689+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:44.710 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.705+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:44.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.725+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:44.747 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:44.749 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:44.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:44.750 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:44.745+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:45.046 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:45.041+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:48:45.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:45.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:45.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:45.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:45.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:45.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:45.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:45.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:45.167 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:45.161+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:45.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:45.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:45.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:45.225+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:45.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:45.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:45.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:45.973+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:46.010 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:46.005+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:46.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:46.021+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:46.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:46.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:46.082 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:46.077+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:46.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:46.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:46.104 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:46.101+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:46.132 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:46.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:48.591 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:48.585+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:48.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:48.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:48.610 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:48.601+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:48.662 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:48.657+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:48.671 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:48.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:48.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:48.669+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:48.685 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:48.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:49.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:49.217+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:49.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:49.229+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:49.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:49.245+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:49.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:49.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:49.279 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:49.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:49.310 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:49.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:51.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.017+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:51.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:51.087 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.081+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:51.093 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.089+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:51.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.141+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:51.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:51.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:51.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:51.243 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:51.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.241+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:48:51.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.289+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:51.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.297+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:51.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:51.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:51.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.313+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:51.333 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.329+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:51.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.349+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:51.410 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.405+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:51.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:51.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:51.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:51.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:52.156 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:52.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:52.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:52.157+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:52.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:52.177+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:52.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:52.181+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:52.207 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:52.205+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:52.210 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:52.209+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:52.874 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:52.869+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:48:52.875 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:52.869+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:48:52.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:52.953+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:48:52.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:52.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:52.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:52.985+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:53.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:53.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:53.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:53.118 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.109+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:53.131 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:53.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.153+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:53.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.165+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:53.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:53.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.169+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:53.219 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.213+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:53.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.265+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:53.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.273+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:53.280 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.277+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:53.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:53.306 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.305+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:53.342 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:53.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:53.385+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:54.225 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.221+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:54.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.257+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:54.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.301+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:54.311 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.309+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:54.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.317+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:54.327 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.325+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:54.340 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.337+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:54.349 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.345+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:54.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.681+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:54.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:54.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.717+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:54.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:54.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:54.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.769+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:54.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:54.892 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.889+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:54.924 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.921+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:48:54.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.925+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:54.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:54.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:54.943 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.937+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:48:54.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:54.963 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.957+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:48:54.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:54.961+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:55.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.001+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:55.577 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:48:55.712 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.709+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:55.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.721+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:55.763 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.761+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:55.779 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.777+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:48:55.804 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.801+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:55.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:55.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:48:55.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:48:55.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:48:55.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:48:55.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:48:55.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:48:55.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:48:55.820 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:48:55.813+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:48:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:48:56.376 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:48:56.455 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2852,"stamp":"2023-09-23T08:48:54.712018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23876947275,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2570080,"num_read_kb":10125494,"num_write":2552528,"num_write_kb":10210483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80405,"ondisk_log_size":80405,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24546164,"kb_used_data":18733788,"kb_used_omap":1786,"kb_used_meta":5810565,"kb_avail":258569356,"statfs":{"total":289910292480,"available":264775020544,"internally_reserved":0,"allocated":19183398912,"data_stored":23095035941,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1829439,"internal_metadata":5950019009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,7,9,15,11,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8478720,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4081,"num_read_kb":16296,"num_write":4242,"num_write_kb":16968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002318"},"pg_stats":[{"pgid":"2.7","version":"88'317041","reported_seq":622502,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:52.906027+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:48:52.906027+0000","last_peered":"2023-09-23T08:48:52.906027+0000","last_clean":"2023-09-23T08:48:52.906027+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:48:52.906027+0000","last_undegraded":"2023-09-23T08:48:52.906027+0000","last_fullsized":"2023-09-23T08:48:52.906027+0000","mapping_epoch":13,"log_start":"88'307011","ondisk_log_start":"88'307011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2814193999,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":304201,"num_read_kb":1198562,"num_write":300769,"num_write_kb":1202980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'349437","reported_seq":686165,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:48:52.839817+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:48:52.839817+0000","last_peered":"2023-09-23T08:48:52.839817+0000","last_clean":"2023-09-23T08:48:52.839817+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:48:52.839817+0000","last_undegraded":"2023-09-23T08:48:52.839817+0000","last_fullsized":"2023-09-23T08:48:52.839817+0000","mapping_epoch":13,"log_start":"88'339408","ondisk_log_start":"88'339408","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1266,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 681s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3144655167,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":336215,"num_read_kb":1320578,"num_write":333216,"num_write_kb":1332633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'330849","reported_seq":647953,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:52.918129+0000","last_change":"2023-09-23T08:47:37.029341+0000","last_active":"2023-09-23T08:48:52.918129+0000","last_peered":"2023-09-23T08:48:52.918129+0000","last_clean":"2023-09-23T08:48:52.918129+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:48:52.918129+0000","last_undegraded":"2023-09-23T08:48:52.918129+0000","last_fullsized":"2023-09-23T08:48:52.918129+0000","mapping_epoch":13,"log_start":"88'320811","ondisk_log_start":"88'320811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'326949","last_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_deep_scrub":"88'326949","last_deep_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_clean_scrub_stamp":"2023-09-23T08:47:37.029020+0000","objects_scrubbed":1230,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:11:05.589408+0000","scrub_duration":554.13017261499999,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2927272236,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":315805,"num_read_kb":1244205,"num_write":314613,"num_write_kb":1258365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1524,"num_omap_keys":30,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'336275","reported_seq":671755,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:52.937601+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:48:52.937601+0000","last_peered":"2023-09-23T08:48:52.937601+0000","last_clean":"2023-09-23T08:48:52.937601+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:48:52.937601+0000","last_undegraded":"2023-09-23T08:48:52.937601+0000","last_fullsized":"2023-09-23T08:48:52.937601+0000","mapping_epoch":13,"log_start":"88'326212","ondisk_log_start":"88'326212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3132412186,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":335856,"num_read_kb":1329227,"num_write":334652,"num_write_kb":1338521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'327875","reported_seq":653759,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:54.581316+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:48:54.581316+0000","last_peered":"2023-09-23T08:48:54.581316+0000","last_clean":"2023-09-23T08:48:54.581316+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:48:54.581316+0000","last_undegraded":"2023-09-23T08:48:54.581316+0000","last_fullsized":"2023-09-23T08:48:54.581316+0000","mapping_epoch":13,"log_start":"88'317809","ondisk_log_start":"88'317809","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3023774014,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":325246,"num_read_kb":1281691,"num_write":324167,"num_write_kb":1296518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'338639","reported_seq":673023,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:50.519014+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:48:50.519014+0000","last_peered":"2023-09-23T08:48:50.519014+0000","last_clean":"2023-09-23T08:48:50.519014+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:48:50.519014+0000","last_undegraded":"2023-09-23T08:48:50.519014+0000","last_fullsized":"2023-09-23T08:48:50.519014+0000","mapping_epoch":13,"log_start":"88'328611","ondisk_log_start":"88'328611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3113882070,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":333132,"num_read_kb":1311820,"num_write":331058,"num_write_kb":1324112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'309842","reported_seq":615817,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:50.518613+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:48:50.518613+0000","last_peered":"2023-09-23T08:48:50.518613+0000","last_clean":"2023-09-23T08:48:50.518613+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:48:50.518613+0000","last_undegraded":"2023-09-23T08:48:50.518613+0000","last_fullsized":"2023-09-23T08:48:50.518613+0000","mapping_epoch":13,"log_start":"88'299808","ondisk_log_start":"88'299808","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2823450925,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":304655,"num_read_kb":1199717,"num_write":302313,"num_write_kb":1209165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'327924","reported_seq":643970,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:48:52.911393+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:48:52.911393+0000","last_peered":"2023-09-23T08:48:52.911393+0000","last_clean":"2023-09-23T08:48:52.911393+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:48:52.911393+0000","last_undegraded":"2023-09-23T08:48:52.911393+0000","last_fullsized":"2023-09-23T08:48:52.911393+0000","mapping_epoch":13,"log_start":"88'317906","ondisk_log_start":"88'317906","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2896716310,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":314864,"num_read_kb":1239603,"num_write":311603,"num_write_kb":1246295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":269,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:44:49.733021+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:44:49.733021+0000","last_peered":"2023-09-23T08:44:49.733021+0000","last_clean":"2023-09-23T08:44:49.733021+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:44:49.733021+0000","last_undegraded":"2023-09-23T08:44:49.733021+0000","last_fullsized":"2023-09-23T08:44:49.733021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23876356907,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2569974,"num_read_kb":10125403,"num_write":2552391,"num_write_kb":10208589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19181322240,"data_stored":23093147222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80306,"ondisk_log_size":80306,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739475,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5302684,"kb_used_data":3468436,"kb_used_omap":335,"kb_used_meta":1833904,"kb_avail":89069156,"statfs":{"total":96636764160,"available":91206815744,"internally_reserved":0,"allocated":3551678464,"data_stored":4268120478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":343753,"internal_metadata":1877918007},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,3,3,1,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.77500000000000002,"15min":0.80600000000000005},"min":{"1min":0.23899999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":3.476,"5min":6.2140000000000004,"15min":7.7039999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.26200000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.5489999999999999,"5min":6.2460000000000004,"15min":14.997999999999999},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.222,"15min":1.101},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.21199999999999999},"max":{"1min":4.4889999999999999,"5min":6.4960000000000004,"15min":10.759},"last":0.35499999999999998},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.274,"15min":1.258},"min":{"1min":0.23100000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":4.6879999999999997,"5min":9.6850000000000005,"15min":12.379},"last":0.254}]}]},{"osd":1,"up_from":8,"seq":34359739458,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11309608,"kb_used_data":9366496,"kb_used_omap":899,"kb_used_meta":1942204,"kb_avail":83062232,"statfs":{"total":96636764160,"available":85055725568,"internally_reserved":0,"allocated":9591291904,"data_stored":11547312592,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":1988817631},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,3,5,8,8,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.92900000000000005,"15min":0.72399999999999998},"min":{"1min":0.23999999999999999,"5min":0.217,"15min":0.191},"max":{"1min":3.8719999999999999,"5min":10.898,"15min":10.898},"last":0.28899999999999998},{"interface":"front","average":{"1min":1.228,"5min":0.96799999999999997,"15min":1.085},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":7.0960000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":0.27100000000000002}]},{"osd":2,"last update":"Sat Sep 23 08:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.4650000000000001,"15min":0.98799999999999999},"min":{"1min":0.248,"5min":0.183,"15min":0.183},"max":{"1min":5.6429999999999998,"5min":12.102,"15min":12.102},"last":0.34000000000000002},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.371,"15min":0.92000000000000004},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":5.6070000000000002,"5min":12.148999999999999,"15min":12.148999999999999},"last":0.32100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739471,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7933872,"kb_used_data":5898856,"kb_used_omap":551,"kb_used_meta":2034456,"kb_avail":86437968,"statfs":{"total":96636764160,"available":88512479232,"internally_reserved":0,"allocated":6040428544,"data_stored":7279602871,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":2083283371},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,4,1,4,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:48:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.331,"15min":1.1759999999999999},"min":{"1min":0.218,"5min":0.17100000000000001,"15min":0.16400000000000001},"max":{"1min":6.2279999999999998,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.3839999999999999,"15min":1.2529999999999999},"min":{"1min":0.27900000000000003,"5min":0.27000000000000002,"15min":0.224},"max":{"1min":6.266,"5min":7.944,"15min":17.251000000000001},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Sep 23 08:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.1859999999999999,"15min":0.85299999999999998},"min":{"1min":0.20899999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":5.069,"5min":9.1069999999999993,"15min":9.1069999999999993},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.746,"15min":0.58099999999999996},"min":{"1min":0.245,"5min":0.24199999999999999,"15min":0.22800000000000001},"max":{"1min":3.0369999999999999,"5min":7.641,"15min":7.641},"last":0.26600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6039683072,"data_stored":7278749202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9590575104,"data_stored":11546487595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3551064064,"data_stored":4267910425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:48:56.456 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:48:56.457 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:48:59.338 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:59.333+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:48:59.339 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:48:59.333+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:49:00.014 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.009+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:00.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.025+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:00.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.029+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:00.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.045+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:00.063 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.057+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:00.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.061+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:00.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.065+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:00.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:00.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.117+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:00.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.129+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:00.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:00.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.417+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:00.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.421+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:00.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.445+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:00.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:00.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:00.461+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:02.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:02.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.116+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:02.147 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:02.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:02.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:02.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:02.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:02.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:02.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:02.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:02.957 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:02.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:02.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:02.982 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.972+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:02.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:02.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:03.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:03.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:03.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:03.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:03.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.404+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:03.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:03.625 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:03.674 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:03.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:03.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:03.735 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:03.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:03.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:03.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:03.816+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:05.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:05.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:05.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:05.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:05.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:05.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:05.782 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:05.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:05.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:05.807 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:05.808 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:05.804+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:07.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:07.254 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:07.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:07.275 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:07.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:07.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:07.328 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:07.617 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:07.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:07.621 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:07.645 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:07.663 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:07.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:07.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:08.220 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:08.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:08.224 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:08.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:08.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:08.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:08.258 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:08.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:08.284 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:08.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:08.285 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:08.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:08.304 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:08.296+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:08.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:08.360+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:08.394 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:08.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:09.352 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.344+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:09.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:09.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:09.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:09.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.384+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:09.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:09.455 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:09.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:09.460 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.452+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:09.944 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.936+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:09.966 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:09.974 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:09.980 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:09.985 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:09.980+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:10.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:10.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:10.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:10.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:10.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:10.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:10.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:10.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:10.746 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:10.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:10.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.740+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:10.838 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:10.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:10.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:10.891 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:10.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.908+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:10.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:10.961 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:10.962 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:10.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:11.585 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:11.580+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:11.619 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:11.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:11.620 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:11.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:11.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:11.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:11.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:11.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:11.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:11.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:11.651 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:11.648+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:11.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:11.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:11.672 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:11.668+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:13.778 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:13.826 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:13.830 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:13.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:13.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:13.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.832+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:13.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:13.848 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.844+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:13.861 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.856+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:13.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:13.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:13.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:15.716 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:15.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:15.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:15.716+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:15.727 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:15.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:15.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:15.744+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:15.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:15.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:15.790 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:15.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:15.802 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:15.796+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:16.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:49:16.760 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:49:16.752+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:49:16.760 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:49:16.752+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:49:17.051 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:49:17.044+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea20820 2023-09-23T08:49:17.051 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:49:17.044+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea35860 2023-09-23T08:49:17.051 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:49:17.044+0000 7f3edd275640 -1 reset not still connected to 0x55a1dea3f2b0 2023-09-23T08:49:17.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:17.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:17.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:17.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:17.148 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:17.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:17.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:17.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:17.157 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:49:17.158 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:49:17.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:17.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:17.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:17.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:17.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:17.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:17.200 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2863,"stamp":"2023-09-23T08:49:16.716277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23894039883,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2578348,"num_read_kb":10158518,"num_write":2560898,"num_write_kb":10243963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80514,"ondisk_log_size":80514,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24293880,"kb_used_data":18771032,"kb_used_omap":1786,"kb_used_meta":5521029,"kb_avail":258821640,"statfs":{"total":289910292480,"available":265033359360,"internally_reserved":0,"allocated":19221536768,"data_stored":23126755365,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1829439,"internal_metadata":5653534145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,8,6,16,15,8,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9568256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4640,"num_read_kb":18536,"num_write":4702,"num_write_kb":18808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002020"},"pg_stats":[{"pgid":"2.7","version":"88'318018","reported_seq":624459,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:13.576610+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:49:13.576610+0000","last_peered":"2023-09-23T08:49:13.576610+0000","last_clean":"2023-09-23T08:49:13.576610+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:49:13.576610+0000","last_undegraded":"2023-09-23T08:49:13.576610+0000","last_fullsized":"2023-09-23T08:49:13.576610+0000","mapping_epoch":13,"log_start":"88'308011","ondisk_log_start":"88'308011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2816098639,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":305167,"num_read_kb":1202414,"num_write":301681,"num_write_kb":1206628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'350598","reported_seq":688375,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:49:13.618786+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:49:13.618786+0000","last_peered":"2023-09-23T08:49:13.618786+0000","last_clean":"2023-09-23T08:49:13.618786+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:49:13.618786+0000","last_undegraded":"2023-09-23T08:49:13.618786+0000","last_fullsized":"2023-09-23T08:49:13.618786+0000","mapping_epoch":13,"log_start":"88'340508","ondisk_log_start":"88'340508","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1297,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 702s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3146842431,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":337246,"num_read_kb":1324698,"num_write":334291,"num_write_kb":1336933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'331914","reported_seq":649930,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:13.561272+0000","last_change":"2023-09-23T08:47:37.029341+0000","last_active":"2023-09-23T08:49:13.561272+0000","last_peered":"2023-09-23T08:49:13.561272+0000","last_clean":"2023-09-23T08:49:13.561272+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:49:13.561272+0000","last_undegraded":"2023-09-23T08:49:13.561272+0000","last_fullsized":"2023-09-23T08:49:13.561272+0000","mapping_epoch":13,"log_start":"88'321911","ondisk_log_start":"88'321911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'326949","last_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_deep_scrub":"88'326949","last_deep_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_clean_scrub_stamp":"2023-09-23T08:47:37.029020+0000","objects_scrubbed":1230,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:11:05.589408+0000","scrub_duration":554.13017261499999,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2929221932,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":316703,"num_read_kb":1247793,"num_write":315612,"num_write_kb":1262361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1524,"num_omap_keys":30,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'337327","reported_seq":673831,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:13.574901+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:49:13.574901+0000","last_peered":"2023-09-23T08:49:13.574901+0000","last_clean":"2023-09-23T08:49:13.574901+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:49:13.574901+0000","last_undegraded":"2023-09-23T08:49:13.574901+0000","last_fullsized":"2023-09-23T08:49:13.574901+0000","mapping_epoch":13,"log_start":"88'327312","ondisk_log_start":"88'327312","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3134644506,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":336878,"num_read_kb":1333311,"num_write":335704,"num_write_kb":1342729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'328886","reported_seq":655754,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:14.829250+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:49:14.829250+0000","last_peered":"2023-09-23T08:49:14.829250+0000","last_clean":"2023-09-23T08:49:14.829250+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:49:14.829250+0000","last_undegraded":"2023-09-23T08:49:14.829250+0000","last_fullsized":"2023-09-23T08:49:14.829250+0000","mapping_epoch":13,"log_start":"88'318809","ondisk_log_start":"88'318809","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3025858878,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":326225,"num_read_kb":1285603,"num_write":325170,"num_write_kb":1300530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'339880","reported_seq":675515,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:15.669866+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:49:15.669866+0000","last_peered":"2023-09-23T08:49:15.669866+0000","last_clean":"2023-09-23T08:49:15.669866+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:49:15.669866+0000","last_undegraded":"2023-09-23T08:49:15.669866+0000","last_fullsized":"2023-09-23T08:49:15.669866+0000","mapping_epoch":13,"log_start":"88'329811","ondisk_log_start":"88'329811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3116425686,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":334368,"num_read_kb":1316760,"num_write":332275,"num_write_kb":1328980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'310974","reported_seq":618090,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:15.664348+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:49:15.664348+0000","last_peered":"2023-09-23T08:49:15.664348+0000","last_clean":"2023-09-23T08:49:15.664348+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:49:15.664348+0000","last_undegraded":"2023-09-23T08:49:15.664348+0000","last_fullsized":"2023-09-23T08:49:15.664348+0000","mapping_epoch":13,"log_start":"88'300908","ondisk_log_start":"88'300908","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2825609517,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":305789,"num_read_kb":1204245,"num_write":303421,"num_write_kb":1213597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'328994","reported_seq":646053,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:13.578093+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:49:13.578093+0000","last_peered":"2023-09-23T08:49:13.578093+0000","last_clean":"2023-09-23T08:49:13.578093+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:49:13.578093+0000","last_undegraded":"2023-09-23T08:49:13.578093+0000","last_fullsized":"2023-09-23T08:49:13.578093+0000","mapping_epoch":13,"log_start":"88'318906","ondisk_log_start":"88'318906","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2898747926,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":315866,"num_read_kb":1243603,"num_write":312607,"num_write_kb":1250311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":270,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:53.882079+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:46:53.882079+0000","last_peered":"2023-09-23T08:46:53.882079+0000","last_clean":"2023-09-23T08:46:53.882079+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:46:53.882079+0000","last_undegraded":"2023-09-23T08:46:53.882079+0000","last_fullsized":"2023-09-23T08:46:53.882079+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23893449515,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2578242,"num_read_kb":10158427,"num_write":2560761,"num_write_kb":10242069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19220410368,"data_stored":23125644886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80415,"ondisk_log_size":80415,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739480,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5360728,"kb_used_data":3476556,"kb_used_omap":335,"kb_used_meta":1883824,"kb_avail":89011112,"statfs":{"total":96636764160,"available":91147378688,"internally_reserved":0,"allocated":3559993344,"data_stored":4275091870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":343753,"internal_metadata":1929036087},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,3,4,3,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.77500000000000002,"15min":0.80600000000000005},"min":{"1min":0.23899999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":3.476,"5min":6.2140000000000004,"15min":7.7039999999999997},"last":0.375},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.26200000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.5489999999999999,"5min":6.2460000000000004,"15min":14.997999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Sat Sep 23 08:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.222,"15min":1.101},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.21199999999999999},"max":{"1min":4.4889999999999999,"5min":6.4960000000000004,"15min":10.759},"last":0.40699999999999997},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.274,"15min":1.258},"min":{"1min":0.23100000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":4.6879999999999997,"5min":9.6850000000000005,"15min":12.379},"last":0.437}]}]},{"osd":1,"up_from":8,"seq":34359739462,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11470876,"kb_used_data":9384020,"kb_used_omap":899,"kb_used_meta":2085948,"kb_avail":82900964,"statfs":{"total":96636764160,"available":84890587136,"internally_reserved":0,"allocated":9609236480,"data_stored":11562267088,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":2136011487},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,6,2,12,11,5,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.92900000000000005,"15min":0.72399999999999998},"min":{"1min":0.23999999999999999,"5min":0.217,"15min":0.191},"max":{"1min":3.8719999999999999,"5min":10.898,"15min":10.898},"last":3.4119999999999999},{"interface":"front","average":{"1min":1.228,"5min":0.96799999999999997,"15min":1.085},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":7.0960000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":3.4390000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.4650000000000001,"15min":0.98799999999999999},"min":{"1min":0.248,"5min":0.183,"15min":0.183},"max":{"1min":5.6429999999999998,"5min":12.102,"15min":12.102},"last":3.4700000000000002},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.371,"15min":0.92000000000000004},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":5.6070000000000002,"5min":12.148999999999999,"15min":12.148999999999999},"last":9.516}]}]},{"osd":0,"up_from":8,"seq":34359739475,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7462276,"kb_used_data":5910456,"kb_used_omap":551,"kb_used_meta":1551256,"kb_avail":86909564,"statfs":{"total":96636764160,"available":88995393536,"internally_reserved":0,"allocated":6052306944,"data_stored":7289396407,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1588486571},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:48:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.331,"15min":1.1759999999999999},"min":{"1min":0.218,"5min":0.17100000000000001,"15min":0.16400000000000001},"max":{"1min":6.2279999999999998,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":1.52,"5min":1.3839999999999999,"15min":1.2529999999999999},"min":{"1min":0.27900000000000003,"5min":0.27000000000000002,"15min":0.224},"max":{"1min":6.266,"5min":7.944,"15min":17.251000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.1859999999999999,"15min":0.85299999999999998},"min":{"1min":0.20899999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":5.069,"5min":9.1069999999999993,"15min":9.1069999999999993},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.746,"15min":0.58099999999999996},"min":{"1min":0.245,"5min":0.24199999999999999,"15min":0.22800000000000001},"max":{"1min":3.0369999999999999,"5min":7.641,"15min":7.641},"last":0.31}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6051532800,"data_stored":7288522258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9609478144,"data_stored":11562208043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3559399424,"data_stored":4274914585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:49:17.202 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:49:17.203 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:49:17.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:17.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:17.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:17.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:18.386 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:18.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:18.400 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:18.388+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:18.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:18.420+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:18.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:18.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:18.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:18.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:18.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:18.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:19.403 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:19.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:19.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.448+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:19.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:19.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:19.478 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.472+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:19.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:19.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:19.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:19.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:19.566 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.560+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:19.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.612+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:19.780 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.776+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:19.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:19.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.788+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:19.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:19.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:19.818 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:19.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:20.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:20.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:20.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:20.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:20.614 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:20.608+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:20.622 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:20.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:20.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:20.624+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:20.647 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:20.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:20.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:20.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:20.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:20.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:20.691 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:20.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:20.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:20.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:21.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:21.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:21.062 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:21.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:21.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:21.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:21.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:21.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:21.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:21.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:21.081 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:21.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:21.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:21.136+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:22.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:22.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:22.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:22.061 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.056+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:22.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:22.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:22.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:22.124 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:49:22.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:22.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:22.165 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:22.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:22.182 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.176+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:22.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:22.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:22.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:22.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:22.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:23.447 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:23.461 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:23.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:23.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:23.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:23.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:23.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:23.557 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:23.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:23.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:23.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:23.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:24.545 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:49:24.540+0000 7f3edd275640 -1 reset not still connected to 0x55a1df137ee0 2023-09-23T08:49:24.546 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:49:24.540+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:49:27.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:27.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:27.380 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:27.376+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:27.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:27.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:27.419 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:27.412+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:27.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:27.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:27.462 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:27.456+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:27.483 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:27.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:27.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:27.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:27.499 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:27.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:30.693 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:30.688+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:30.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:30.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:30.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:30.720+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:30.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:30.752+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:30.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:30.760+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:30.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:30.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:30.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:30.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:30.828 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:30.824+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:31.080 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:31.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:31.113 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:31.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:31.123 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:31.120+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:31.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:31.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:31.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:31.164+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:31.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:31.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:31.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:31.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:31.256 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:31.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:31.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:31.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:33.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:33.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:33.012 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:33.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:33.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:33.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:33.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:33.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:33.085 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:33.080+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:33.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:33.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:33.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:33.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:33.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:33.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:33.193 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:33.188+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:33.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:33.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:34.103 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:34.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:34.129 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:34.124+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:34.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:34.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:34.163 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:34.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:34.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:34.216+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:34.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:34.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:34.237 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:34.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:34.266 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:34.260+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:35.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:35.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:35.853 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:35.848+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:35.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:35.876+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:35.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:35.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:35.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:35.884+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:35.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:35.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:35.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:35.932+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:35.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:35.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:35.953 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:35.948+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:35.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:35.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:36.518 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:36.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.556+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:36.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:36.599 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.596+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:36.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:36.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:36.643 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.636+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:36.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.652+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:36.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:36.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:36.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:36.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:37.204 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:49:38.073 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:49:38.073 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:49:38.124 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2873,"stamp":"2023-09-23T08:49:36.719485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23910358347,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2586613,"num_read_kb":10191534,"num_write":2568922,"num_write_kb":10276059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80405,"ondisk_log_size":80405,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24587176,"kb_used_data":18807568,"kb_used_omap":1786,"kb_used_meta":5777797,"kb_avail":258528344,"statfs":{"total":289910292480,"available":264733024256,"internally_reserved":0,"allocated":19258949632,"data_stored":23157807141,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1829439,"internal_metadata":5916464577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,17,30,8,10,21,11,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9519104,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4978,"num_read_kb":19876,"num_write":4767,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001909"},"pg_stats":[{"pgid":"2.7","version":"88'319030","reported_seq":626446,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:34.264115+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:49:34.264115+0000","last_peered":"2023-09-23T08:49:34.264115+0000","last_clean":"2023-09-23T08:49:34.264115+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:49:34.264115+0000","last_undegraded":"2023-09-23T08:49:34.264115+0000","last_fullsized":"2023-09-23T08:49:34.264115+0000","mapping_epoch":13,"log_start":"88'309011","ondisk_log_start":"88'309011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2818134351,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":306135,"num_read_kb":1206282,"num_write":302642,"num_write_kb":1210472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'351744","reported_seq":690619,"reported_epoch":88,"state":"active+clean+scrubbing+deep","last_fresh":"2023-09-23T08:49:34.229443+0000","last_change":"2023-09-23T08:37:31.270303+0000","last_active":"2023-09-23T08:49:34.229443+0000","last_peered":"2023-09-23T08:49:34.229443+0000","last_clean":"2023-09-23T08:49:34.229443+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:49:34.229443+0000","last_undegraded":"2023-09-23T08:49:34.229443+0000","last_fullsized":"2023-09-23T08:49:34.229443+0000","mapping_epoch":13,"log_start":"88'341708","ondisk_log_start":"88'341708","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-23T07:16:46.274009+0000","last_clean_scrub_stamp":"2023-09-23T07:16:46.274009+0000","objects_scrubbed":1321,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 723s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3149136191,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":338327,"num_read_kb":1329022,"num_write":335372,"num_write_kb":1341257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'333020","reported_seq":652071,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:34.223239+0000","last_change":"2023-09-23T08:47:37.029341+0000","last_active":"2023-09-23T08:49:34.223239+0000","last_peered":"2023-09-23T08:49:34.223239+0000","last_clean":"2023-09-23T08:49:34.223239+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:49:34.223239+0000","last_undegraded":"2023-09-23T08:49:34.223239+0000","last_fullsized":"2023-09-23T08:49:34.223239+0000","mapping_epoch":13,"log_start":"88'323011","ondisk_log_start":"88'323011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'326949","last_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_deep_scrub":"88'326949","last_deep_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_clean_scrub_stamp":"2023-09-23T08:47:37.029020+0000","objects_scrubbed":1230,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:11:05.589408+0000","scrub_duration":554.13017261499999,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2931220780,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":317729,"num_read_kb":1251885,"num_write":316667,"num_write_kb":1266581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1524,"num_omap_keys":30,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'338378","reported_seq":676001,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:34.220197+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:49:34.220197+0000","last_peered":"2023-09-23T08:49:34.220197+0000","last_clean":"2023-09-23T08:49:34.220197+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:49:34.220197+0000","last_undegraded":"2023-09-23T08:49:34.220197+0000","last_fullsized":"2023-09-23T08:49:34.220197+0000","mapping_epoch":13,"log_start":"88'328312","ondisk_log_start":"88'328312","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3136778522,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":337998,"num_read_kb":1337791,"num_write":336755,"num_write_kb":1346933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'329875","reported_seq":657754,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:35.041641+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:49:35.041641+0000","last_peered":"2023-09-23T08:49:35.041641+0000","last_clean":"2023-09-23T08:49:35.041641+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:49:35.041641+0000","last_undegraded":"2023-09-23T08:49:35.041641+0000","last_fullsized":"2023-09-23T08:49:35.041641+0000","mapping_epoch":13,"log_start":"88'319809","ondisk_log_start":"88'319809","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3027898686,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":327225,"num_read_kb":1289587,"num_write":326155,"num_write_kb":1304470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'340930","reported_seq":677650,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:35.837155+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:49:35.837155+0000","last_peered":"2023-09-23T08:49:35.837155+0000","last_clean":"2023-09-23T08:49:35.837155+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:49:35.837155+0000","last_undegraded":"2023-09-23T08:49:35.837155+0000","last_fullsized":"2023-09-23T08:49:35.837155+0000","mapping_epoch":13,"log_start":"88'330911","ondisk_log_start":"88'330911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3118465494,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":335442,"num_read_kb":1321048,"num_write":333301,"num_write_kb":1333084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'311863","reported_seq":619944,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:35.765890+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:49:35.765890+0000","last_peered":"2023-09-23T08:49:35.765890+0000","last_clean":"2023-09-23T08:49:35.765890+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:49:35.765890+0000","last_undegraded":"2023-09-23T08:49:35.765890+0000","last_fullsized":"2023-09-23T08:49:35.765890+0000","mapping_epoch":13,"log_start":"88'301808","ondisk_log_start":"88'301808","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2827432237,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":306735,"num_read_kb":1208025,"num_write":304289,"num_write_kb":1217069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'330042","reported_seq":648164,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:34.148540+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:49:34.148540+0000","last_peered":"2023-09-23T08:49:34.148540+0000","last_clean":"2023-09-23T08:49:34.148540+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:49:34.148540+0000","last_undegraded":"2023-09-23T08:49:34.148540+0000","last_fullsized":"2023-09-23T08:49:34.148540+0000","mapping_epoch":13,"log_start":"88'320006","ondisk_log_start":"88'320006","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2900701718,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":316916,"num_read_kb":1247803,"num_write":313604,"num_write_kb":1254299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":270,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:53.882079+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:46:53.882079+0000","last_peered":"2023-09-23T08:46:53.882079+0000","last_clean":"2023-09-23T08:46:53.882079+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:46:53.882079+0000","last_undegraded":"2023-09-23T08:46:53.882079+0000","last_fullsized":"2023-09-23T08:46:53.882079+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23909767979,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2586507,"num_read_kb":10191443,"num_write":2568785,"num_write_kb":10274165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12258,"num_omap_keys":238,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19257798656,"data_stored":23156741718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36028,"internal_metadata":0},"log_size":80306,"ondisk_log_size":80306,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739484,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5417204,"kb_used_data":3483052,"kb_used_omap":335,"kb_used_meta":1933808,"kb_avail":88954636,"statfs":{"total":96636764160,"available":91089547264,"internally_reserved":0,"allocated":3566645248,"data_stored":4280580510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":343753,"internal_metadata":1980219703},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,3,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.77500000000000002,"15min":0.80600000000000005},"min":{"1min":0.23899999999999999,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":3.476,"5min":6.2140000000000004,"15min":7.7039999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.26200000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.5489999999999999,"5min":6.2460000000000004,"15min":14.997999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Sat Sep 23 08:48:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.222,"15min":1.101},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.21199999999999999},"max":{"1min":4.4889999999999999,"5min":6.4960000000000004,"15min":10.759},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.274,"15min":1.258},"min":{"1min":0.23100000000000001,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":4.6879999999999997,"5min":9.6850000000000005,"15min":12.379},"last":0.26100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739466,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11619848,"kb_used_data":9402560,"kb_used_omap":899,"kb_used_meta":2216380,"kb_avail":82751992,"statfs":{"total":96636764160,"available":84738039808,"internally_reserved":0,"allocated":9628221440,"data_stored":11578008016,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":920865,"internal_metadata":2269573855},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,16,30,3,5,16,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.92900000000000005,"15min":0.72399999999999998},"min":{"1min":0.23999999999999999,"5min":0.217,"15min":0.191},"max":{"1min":3.8719999999999999,"5min":10.898,"15min":10.898},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.228,"5min":0.96799999999999997,"15min":1.085},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.17599999999999999},"max":{"1min":7.0960000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:48:37 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.4650000000000001,"15min":0.98799999999999999},"min":{"1min":0.248,"5min":0.183,"15min":0.183},"max":{"1min":5.6429999999999998,"5min":12.102,"15min":12.102},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.371,"15min":0.92000000000000004},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":5.6070000000000002,"5min":12.148999999999999,"15min":12.148999999999999},"last":0.83499999999999996}]}]},{"osd":0,"up_from":8,"seq":34359739479,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7550124,"kb_used_data":5921956,"kb_used_omap":551,"kb_used_meta":1627608,"kb_avail":86821716,"statfs":{"total":96636764160,"available":88905437184,"internally_reserved":0,"allocated":6064082944,"data_stored":7299218615,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1666671019},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,0,2,3,5,3,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:48:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.331,"15min":1.1759999999999999},"min":{"1min":0.218,"5min":0.17100000000000001,"15min":0.16400000000000001},"max":{"1min":6.2279999999999998,"5min":7.8689999999999998,"15min":17.216000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.3839999999999999,"15min":1.2529999999999999},"min":{"1min":0.27900000000000003,"5min":0.27000000000000002,"15min":0.224},"max":{"1min":6.266,"5min":7.944,"15min":17.251000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Sat Sep 23 08:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.163,"15min":0.91800000000000004},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.19900000000000001},"max":{"1min":10.763,"5min":10.763,"15min":10.763},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.73999999999999999,"15min":0.61099999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.22800000000000001},"max":{"1min":3.9550000000000001,"5min":7.641,"15min":7.641},"last":0.27900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6063325184,"data_stored":7298360850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9628397568,"data_stored":11577961259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16675,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3566075904,"data_stored":4280419609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:49:38.126 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-23T07:16:46.274009+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=7, tm_min=16, tm_sec=46, tm_wday=5, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=23, tm_hour=8, tm_min=22, tm_sec=34, tm_wday=5, tm_yday=266, tm_isdst=0) 2023-09-23T08:49:38.126 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-23T08:49:38.144 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:38.140+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:38.149 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:38.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:38.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:38.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:38.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:38.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:38.223 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:38.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:38.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:38.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:38.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:38.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:39.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:39.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:39.554 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:39.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:39.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:39.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:39.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:39.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:39.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:39.628+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:39.664 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:39.660+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:39.706 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:39.700+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:39.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:39.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:39.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:39.704+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:39.718 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:39.712+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:40.109 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:40.116 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.104+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:40.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:40.133 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.128+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:40.138 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:40.158 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:40.173 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:40.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:40.229 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:40.648 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:40.714 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.708+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:40.731 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.724+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:40.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.728+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:40.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:40.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.732+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:40.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:40.754 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.748+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:40.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.772+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:40.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:40.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:40.800+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:42.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:42.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:42.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:42.232+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:42.274 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:42.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:42.288 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:42.284+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:42.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:42.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:42.307 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:42.304+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:42.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:42.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:42.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:42.352+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:42.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:42.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:42.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:42.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:43.030 INFO:tasks.ceph.osd.2.smithi107.stderr:2023-09-23T08:49:43.024+0000 7f3edd275640 -1 reset not still connected to 0x55a1df63de10 2023-09-23T08:49:45.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:45.780+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:45.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:45.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:45.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:45.836+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:45.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:45.860+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:45.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:45.864+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:45.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:45.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:45.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:45.892+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:45.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:45.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:45.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:45.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:45.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:45.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:46.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:46.272+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:46.295 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:46.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:46.331 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:46.324+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:46.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:46.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:46.356 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:46.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:46.361 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:46.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:46.362 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:46.356+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:46.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:46.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:46.413 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:46.408+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:47.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:47.184+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:47.204 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:47.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:47.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:47.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:47.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:47.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:47.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:47.252+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:47.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:47.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:47.964 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:47.956+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:47.983 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:47.976+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:47.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:47.988+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:48.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:48.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:48.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:48.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:48.006 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:48.000+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:48.007 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:48.004+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:48.025 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:48.016+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:48.038 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:48.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:48.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:48.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:48.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:48.032+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:50.405 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:50.396+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:50.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:50.400+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:50.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:50.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:50.448 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:50.440+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:50.450 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:50.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:50.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:50.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:50.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:50.528+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:50.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:50.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:51.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:51.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:51.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:51.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:51.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:51.196+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:51.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:51.204+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:51.212 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:51.208+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:51.251 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:51.244+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:51.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:51.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:52.670 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:52.664+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:52.690 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:52.684+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:52.698 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:52.692+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:52.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:52.736+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:52.761 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:52.756+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:52.791 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:52.784+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:52.811 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:52.808+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:52.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:52.812+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:52.823 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:52.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:52.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:52.820+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:53.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:53.428+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:53.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:53.436+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:53.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:53.444+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:53.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:53.460+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:53.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:53.464+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:53.497 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:53.488+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:53.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:53.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:53.551 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:53.544+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:53.553 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:53.548+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:54.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:54.952+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:49:54.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:54.984+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:55.016 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:55.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:55.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:55.024+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:55.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:55.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:55.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:55.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:55.043 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:55.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:55.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:55.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:55.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:55.044+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:55.057 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:55.052+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:55.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:55.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:55.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:55.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:56.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.200+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:56.226 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.220+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:56.233 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:56.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.276+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:56.312 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:56.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:56.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.328+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:56.351 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.348+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:56.367 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:56.369 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.364+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:56.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.372+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:56.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.768+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:56.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:56.833 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.828+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:56.844 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.840+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:56.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:56.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:56.878 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.872+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:56.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:56.965 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.960+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:57.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:56.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:57.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.008+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:57.033 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.028+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:57.045 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.036+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:57.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:57.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.132+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:57.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:57.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:57.474 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.468+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:57.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:57.522 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.512+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:57.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:57.559 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.552+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:57.594 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.588+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:57.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:57.608 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.604+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:57.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:57.623 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.616+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:57.650 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.644+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:57.675 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:57.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.656+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:57.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:57.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:57.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:57.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:58.127 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-23T08:49:58.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-09-23T08:49:58.628+0000 7f25dd099640 0 --2- 172.21.15.107:0/77702174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25c4004ae0 0x7f25c4004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-09-23T08:49:58.983 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-09-23T08:49:58.984 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-09-23T08:49:59.032 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":2884,"stamp":"2023-09-23T08:49:58.727152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23926779211,"num_objects":10096,"num_object_clones":6000,"num_object_copies":20192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10096,"num_whiteouts":0,"num_read":2594393,"num_read_kb":10222610,"num_write":2576907,"num_write_kb":10307999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15624,"num_omap_keys":313,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80515,"ondisk_log_size":80515,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23578948,"kb_used_data":18845468,"kb_used_omap":1406,"kb_used_meta":4732033,"kb_avail":259536572,"statfs":{"total":289910292480,"available":265765449728,"internally_reserved":0,"allocated":19297759232,"data_stored":23190681637,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":1440584,"internal_metadata":4845601976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,3,7,13,12,5,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8413184,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3931,"num_read_kb":15704,"num_write":4097,"num_write_kb":16388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006047"},"pg_stats":[{"pgid":"2.7","version":"88'320080","reported_seq":628462,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:54.907943+0000","last_change":"2023-09-23T08:38:21.853756+0000","last_active":"2023-09-23T08:49:54.907943+0000","last_peered":"2023-09-23T08:49:54.907943+0000","last_clean":"2023-09-23T08:49:54.907943+0000","last_became_active":"2023-09-23T07:16:47.300705+0000","last_became_peered":"2023-09-23T07:16:47.300705+0000","last_unstale":"2023-09-23T08:49:54.907943+0000","last_undegraded":"2023-09-23T08:49:54.907943+0000","last_fullsized":"2023-09-23T08:49:54.907943+0000","mapping_epoch":13,"log_start":"88'310011","ondisk_log_start":"88'310011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'287304","last_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_deep_scrub":"88'287304","last_deep_scrub_stamp":"2023-09-23T08:38:21.853587+0000","last_clean_scrub_stamp":"2023-09-23T08:38:21.853587+0000","objects_scrubbed":1201,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":454,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T12:57:38.818599+0000","scrub_duration":453.809561019,"objects_trimmed":0,"snaptrim_duration":2.4844956690000002,"stat_sum":{"num_bytes":2820206927,"num_objects":1201,"num_object_clones":718,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":307085,"num_read_kb":1210074,"num_write":303644,"num_write_kb":1214480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1741,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"88'352843","reported_seq":692784,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:54.883811+0000","last_change":"2023-09-23T08:49:41.757187+0000","last_active":"2023-09-23T08:49:54.883811+0000","last_peered":"2023-09-23T08:49:54.883811+0000","last_clean":"2023-09-23T08:49:54.883811+0000","last_became_active":"2023-09-23T07:16:47.300534+0000","last_became_peered":"2023-09-23T07:16:47.300534+0000","last_unstale":"2023-09-23T08:49:54.883811+0000","last_undegraded":"2023-09-23T08:49:54.883811+0000","last_fullsized":"2023-09-23T08:49:54.883811+0000","mapping_epoch":13,"log_start":"88'342808","ondisk_log_start":"88'342808","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'352132","last_scrub_stamp":"2023-09-23T08:49:41.757014+0000","last_deep_scrub":"88'352132","last_deep_scrub_stamp":"2023-09-23T08:49:41.757014+0000","last_clean_scrub_stamp":"2023-09-23T08:49:41.757014+0000","objects_scrubbed":1336,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":731,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:49:06.125119+0000","scrub_duration":730.48659026400003,"objects_trimmed":0,"snaptrim_duration":2.398964415,"stat_sum":{"num_bytes":3151413567,"num_objects":1336,"num_object_clones":803,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":0,"num_read":339370,"num_read_kb":1333178,"num_write":336413,"num_write_kb":1345421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3366,"num_omap_keys":75,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"88'334047","reported_seq":654079,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:54.887096+0000","last_change":"2023-09-23T08:47:37.029341+0000","last_active":"2023-09-23T08:49:54.887096+0000","last_peered":"2023-09-23T08:49:54.887096+0000","last_clean":"2023-09-23T08:49:54.887096+0000","last_became_active":"2023-09-23T07:16:47.303373+0000","last_became_peered":"2023-09-23T07:16:47.303373+0000","last_unstale":"2023-09-23T08:49:54.887096+0000","last_undegraded":"2023-09-23T08:49:54.887096+0000","last_fullsized":"2023-09-23T08:49:54.887096+0000","mapping_epoch":13,"log_start":"88'324011","ondisk_log_start":"88'324011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'326949","last_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_deep_scrub":"88'326949","last_deep_scrub_stamp":"2023-09-23T08:47:37.029020+0000","last_clean_scrub_stamp":"2023-09-23T08:47:37.029020+0000","objects_scrubbed":1230,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T13:11:05.589408+0000","scrub_duration":554.13017261499999,"objects_trimmed":0,"snaptrim_duration":2.437806283,"stat_sum":{"num_bytes":2933256492,"num_objects":1230,"num_object_clones":727,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":318694,"num_read_kb":1255733,"num_write":317646,"num_write_kb":1270497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1524,"num_omap_keys":30,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"88'339446","reported_seq":678112,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:54.908297+0000","last_change":"2023-09-23T08:42:49.811380+0000","last_active":"2023-09-23T08:49:54.908297+0000","last_peered":"2023-09-23T08:49:54.908297+0000","last_clean":"2023-09-23T08:49:54.908297+0000","last_became_active":"2023-09-23T07:16:47.300513+0000","last_became_peered":"2023-09-23T07:16:47.300513+0000","last_unstale":"2023-09-23T08:49:54.908297+0000","last_undegraded":"2023-09-23T08:49:54.908297+0000","last_fullsized":"2023-09-23T08:49:54.908297+0000","mapping_epoch":13,"log_start":"88'329412","ondisk_log_start":"88'329412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'318083","last_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_deep_scrub":"88'318083","last_deep_scrub_stamp":"2023-09-23T08:42:49.810294+0000","last_clean_scrub_stamp":"2023-09-23T08:42:49.810294+0000","objects_scrubbed":1323,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":655,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:05:32.577361+0000","scrub_duration":654.03051555000002,"objects_trimmed":0,"snaptrim_duration":2.5197408939999999,"stat_sum":{"num_bytes":3138863386,"num_objects":1323,"num_object_clones":788,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":339041,"num_read_kb":1341963,"num_write":337823,"num_write_kb":1351205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":40,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"88'330876","reported_seq":659730,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:55.198074+0000","last_change":"2023-09-23T08:30:46.173622+0000","last_active":"2023-09-23T08:49:55.198074+0000","last_peered":"2023-09-23T08:49:55.198074+0000","last_clean":"2023-09-23T08:49:55.198074+0000","last_became_active":"2023-09-23T07:16:47.302147+0000","last_became_peered":"2023-09-23T07:16:47.302147+0000","last_unstale":"2023-09-23T08:49:55.198074+0000","last_undegraded":"2023-09-23T08:49:55.198074+0000","last_fullsized":"2023-09-23T08:49:55.198074+0000","mapping_epoch":13,"log_start":"88'320809","ondisk_log_start":"88'320809","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'275062","last_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_deep_scrub":"85'275062","last_deep_scrub_stamp":"2023-09-23T08:30:46.173326+0000","last_clean_scrub_stamp":"2023-09-23T08:30:46.173326+0000","objects_scrubbed":1280,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":489,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T17:53:47.703929+0000","scrub_duration":488.92501549799999,"objects_trimmed":0,"snaptrim_duration":0.0068748510000000004,"stat_sum":{"num_bytes":3029942590,"num_objects":1280,"num_object_clones":761,"num_object_copies":2560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":328193,"num_read_kb":1293459,"num_write":327148,"num_write_kb":1308442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":42,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"88'341941","reported_seq":679625,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:55.913856+0000","last_change":"2023-09-23T08:37:30.020619+0000","last_active":"2023-09-23T08:49:55.913856+0000","last_peered":"2023-09-23T08:49:55.913856+0000","last_clean":"2023-09-23T08:49:55.913856+0000","last_became_active":"2023-09-23T07:16:47.303280+0000","last_became_peered":"2023-09-23T07:16:47.303280+0000","last_unstale":"2023-09-23T08:49:55.913856+0000","last_undegraded":"2023-09-23T08:49:55.913856+0000","last_fullsized":"2023-09-23T08:49:55.913856+0000","mapping_epoch":13,"log_start":"88'331911","ondisk_log_start":"88'331911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'305047","last_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_deep_scrub":"88'305047","last_deep_scrub_stamp":"2023-09-23T08:37:30.020443+0000","last_clean_scrub_stamp":"2023-09-23T08:37:30.020443+0000","objects_scrubbed":1310,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":510,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:09:36.231640+0000","scrub_duration":509.59082012800002,"objects_trimmed":0,"snaptrim_duration":0.136269374,"stat_sum":{"num_bytes":3120538070,"num_objects":1310,"num_object_clones":778,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":336391,"num_read_kb":1324844,"num_write":334306,"num_write_kb":1337104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2175,"num_omap_keys":33,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"88'312772","reported_seq":621783,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:55.912875+0000","last_change":"2023-09-23T08:28:58.062290+0000","last_active":"2023-09-23T08:49:55.912875+0000","last_peered":"2023-09-23T08:49:55.912875+0000","last_clean":"2023-09-23T08:49:55.912875+0000","last_became_active":"2023-09-23T07:16:47.301324+0000","last_became_peered":"2023-09-23T07:16:47.301324+0000","last_unstale":"2023-09-23T08:49:55.912875+0000","last_undegraded":"2023-09-23T08:49:55.912875+0000","last_fullsized":"2023-09-23T08:49:55.912875+0000","mapping_epoch":13,"log_start":"88'302708","ondisk_log_start":"88'302708","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'255165","last_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_deep_scrub":"84'255165","last_deep_scrub_stamp":"2023-09-23T08:28:58.062123+0000","last_clean_scrub_stamp":"2023-09-23T08:28:58.062123+0000","objects_scrubbed":1197,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":378,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T15:17:21.194527+0000","scrub_duration":377.37438671400002,"objects_trimmed":0,"snaptrim_duration":0.011402489,"stat_sum":{"num_bytes":2829275437,"num_objects":1197,"num_object_clones":712,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":307653,"num_read_kb":1211693,"num_write":305189,"num_write_kb":1220669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1522,"num_omap_keys":30,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"88'331087","reported_seq":650166,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:49:54.883154+0000","last_change":"2023-09-23T08:31:55.288279+0000","last_active":"2023-09-23T08:49:54.883154+0000","last_peered":"2023-09-23T08:49:54.883154+0000","last_clean":"2023-09-23T08:49:54.883154+0000","last_became_active":"2023-09-23T07:16:47.300241+0000","last_became_peered":"2023-09-23T07:16:47.300241+0000","last_unstale":"2023-09-23T08:49:54.883154+0000","last_undegraded":"2023-09-23T08:49:54.883154+0000","last_fullsized":"2023-09-23T08:49:54.883154+0000","mapping_epoch":13,"log_start":"88'321006","ondisk_log_start":"88'321006","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'278382","last_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_deep_scrub":"86'278382","last_deep_scrub_stamp":"2023-09-23T08:31:55.288146+0000","last_clean_scrub_stamp":"2023-09-23T08:31:55.288146+0000","objects_scrubbed":1217,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":555,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T16:02:58.163939+0000","scrub_duration":554.11361567500001,"objects_trimmed":0,"snaptrim_duration":2.4886631289999999,"stat_sum":{"num_bytes":2902692374,"num_objects":1217,"num_object_clones":713,"num_object_copies":2434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":317860,"num_read_kb":1251575,"num_write":314601,"num_write_kb":1258287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1958,"num_omap_keys":32,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"79'99","reported_seq":270,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-09-23T08:46:53.882079+0000","last_change":"2023-09-23T08:22:40.293082+0000","last_active":"2023-09-23T08:46:53.882079+0000","last_peered":"2023-09-23T08:46:53.882079+0000","last_clean":"2023-09-23T08:46:53.882079+0000","last_became_active":"2023-09-23T07:16:44.815490+0000","last_became_peered":"2023-09-23T07:16:44.815490+0000","last_unstale":"2023-09-23T08:46:53.882079+0000","last_undegraded":"2023-09-23T08:46:53.882079+0000","last_fullsized":"2023-09-23T08:46:53.882079+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'99","last_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_deep_scrub":"79'99","last_deep_scrub_stamp":"2023-09-23T08:22:40.292964+0000","last_clean_scrub_stamp":"2023-09-23T08:22:40.292964+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-24T19:29:57.133234+0000","scrub_duration":0.099106962000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":23926188843,"num_objects":10094,"num_object_clones":6000,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10094,"num_whiteouts":0,"num_read":2594287,"num_read_kb":10222519,"num_write":2576770,"num_write_kb":10306105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15624,"num_omap_keys":313,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19295830016,"data_stored":23188919894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35077,"internal_metadata":0},"log_size":80416,"ondisk_log_size":80416,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7470,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739488,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5508408,"kb_used_data":3489648,"kb_used_omap":335,"kb_used_meta":2018416,"kb_avail":88863432,"statfs":{"total":96636764160,"available":90996154368,"internally_reserved":0,"allocated":3573399552,"data_stored":4286364062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":343753,"internal_metadata":2066858295},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,1,0,2,4,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.68600000000000005,"15min":0.747},"min":{"1min":0.222,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.88100000000000001,"5min":5.3979999999999997,"15min":7.7039999999999997},"last":0.308},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.68600000000000005,"15min":0.76600000000000001},"min":{"1min":0.251,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":2.177,"5min":5.5119999999999996,"15min":14.997999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Sep 23 08:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.98899999999999999,"15min":1.03},"min":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":1.6299999999999999,"5min":5.9610000000000003,"15min":10.759},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.1619999999999999,"15min":1.24},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.184},"max":{"1min":5.827,"5min":9.6850000000000005,"15min":12.379},"last":0.47899999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739470,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10427692,"kb_used_data":9422168,"kb_used_omap":519,"kb_used_meta":1004984,"kb_avail":83944148,"statfs":{"total":96636764160,"available":85958807552,"internally_reserved":0,"allocated":9648300032,"data_stored":11594998224,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":532010,"internal_metadata":1029104086},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,2,4,10,8,5,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 23 08:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.747,"15min":0.72999999999999998},"min":{"1min":0.23799999999999999,"5min":0.219,"15min":0.191},"max":{"1min":3.4119999999999999,"5min":10.898,"15min":10.898},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.83999999999999997,"15min":1.0840000000000001},"min":{"1min":0.23499999999999999,"5min":0.19600000000000001,"15min":0.17599999999999999},"max":{"1min":3.4390000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":0.25800000000000001}]},{"osd":2,"last update":"Sat Sep 23 08:49:41 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.3140000000000001,"15min":0.97599999999999998},"min":{"1min":0.24099999999999999,"5min":0.23799999999999999,"15min":0.183},"max":{"1min":3.661,"5min":12.102,"15min":12.102},"last":6.6440000000000001},{"interface":"front","average":{"1min":1.637,"5min":1.3069999999999999,"15min":0.98899999999999999},"min":{"1min":0.27500000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":9.516,"5min":12.148999999999999,"15min":12.148999999999999},"last":6.7750000000000004}]}]},{"osd":0,"up_from":8,"seq":34359739483,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7642848,"kb_used_data":5933652,"kb_used_omap":551,"kb_used_meta":1708632,"kb_avail":86728992,"statfs":{"total":96636764160,"available":88810487808,"internally_reserved":0,"allocated":6076059648,"data_stored":7309319351,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":564821,"internal_metadata":1749639595},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 23 08:49:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":1.095,"15min":1.1200000000000001},"min":{"1min":0.24199999999999999,"5min":0.17100000000000001,"15min":0.16400000000000001},"max":{"1min":1.7,"5min":6.5010000000000003,"15min":17.216000000000001},"last":1.9119999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.153,"15min":1.1990000000000001},"min":{"1min":0.28100000000000003,"5min":0.27000000000000002,"15min":0.224},"max":{"1min":1.746,"5min":6.5330000000000004,"15min":17.251000000000001},"last":1.9419999999999999}]},{"osd":2,"last update":"Sat Sep 23 08:49:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.163,"15min":0.91800000000000004},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.19900000000000001},"max":{"1min":10.763,"5min":10.763,"15min":10.763},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.73999999999999999,"15min":0.61099999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.22800000000000001},"max":{"1min":3.9550000000000001,"5min":7.641,"15min":7.641},"last":0.224}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3735,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6075297792,"data_stored":7308453394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11972,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9647665152,"data_stored":11594246955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15724,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3572867072,"data_stored":4286219545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7381,"internal_metadata":0}]}} 2023-09-23T08:49:59.034 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-23T08:49:59.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:59.071 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.068+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:59.112 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:59.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.152+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:59.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:59.195 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:59.198 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:59.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:59.299 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:49:59.296+0000 7fbe3c499640 -1 reset not still connected to 0x561ec795b860 2023-09-23T08:49:59.300 INFO:tasks.ceph.osd.0.smithi107.stderr:2023-09-23T08:49:59.296+0000 7fbe3c499640 -1 reset not still connected to 0x561ec86d89c0 2023-09-23T08:49:59.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.564+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af51c70 2023-09-23T08:49:59.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.568+0000 7ff9e8051640 -1 reset not still connected to 0x55c12af89ba0 2023-09-23T08:49:59.574 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.572+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:59.624 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.620+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:59.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:59.646 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.640+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb432b0 2023-09-23T08:49:59.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.672+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:59.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.680+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:59.702 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:59.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c029ad0 2023-09-23T08:49:59.703 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.696+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:49:59.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:49:59.884 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.880+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b72d930 2023-09-23T08:49:59.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb24410 2023-09-23T08:49:59.895 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.888+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:49:59.912 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-23T08:49:59.912 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-23T08:49:59.912 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-23T08:49:59.912 INFO:teuthology.orchestra.run:waiting for 300 2023-09-23T08:49:59.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.912+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bba35f0 2023-09-23T08:49:59.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bf17d40 2023-09-23T08:49:59.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.916+0000 7ff9e8051640 -1 reset not still connected to 0x55c12c001450 2023-09-23T08:49:59.937 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:49:59.928+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:50:02.485 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:02.480+0000 7ff9e8051640 -1 reset not still connected to 0x55c13895b860 2023-09-23T08:50:02.519 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:02.516+0000 7ff9e8051640 -1 reset not still connected to 0x55c161860c30 2023-09-23T08:50:02.527 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:02.524+0000 7ff9e8051640 -1 reset not still connected to 0x55c16af7ad00 2023-09-23T08:50:02.543 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:02.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c16b1040d0 2023-09-23T08:50:02.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:02.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c16f3a6dd0 2023-09-23T08:50:02.544 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:02.540+0000 7ff9e8051640 -1 reset not still connected to 0x55c1859ad5f0 2023-09-23T08:50:03.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.040+0000 7ff9e8051640 -1 reset not still connected to 0x55c132fc3ad0 2023-09-23T08:50:03.069 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.064+0000 7ff9e8051640 -1 reset not still connected to 0x55c1372fa820 2023-09-23T08:50:03.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c1380b1450 2023-09-23T08:50:03.079 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.076+0000 7ff9e8051640 -1 reset not still connected to 0x55c13895b860 2023-09-23T08:50:03.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c142c26a90 2023-09-23T08:50:03.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.084+0000 7ff9e8051640 -1 reset not still connected to 0x55c14e69c680 2023-09-23T08:50:03.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.092+0000 7ff9e8051640 -1 reset not still connected to 0x55c161860c30 2023-09-23T08:50:03.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c16af7ad00 2023-09-23T08:50:03.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c16b1040d0 2023-09-23T08:50:03.105 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.100+0000 7ff9e8051640 -1 reset not still connected to 0x55c16f3a6dd0 2023-09-23T08:50:03.115 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.108+0000 7ff9e8051640 -1 reset not still connected to 0x55c1859ad5f0 2023-09-23T08:50:03.232 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c132fc3ad0 2023-09-23T08:50:03.234 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.228+0000 7ff9e8051640 -1 reset not still connected to 0x55c1372fa820 2023-09-23T08:50:03.253 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.248+0000 7ff9e8051640 -1 reset not still connected to 0x55c1380b1450 2023-09-23T08:50:03.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c13895b860 2023-09-23T08:50:03.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c142c26a90 2023-09-23T08:50:03.260 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.256+0000 7ff9e8051640 -1 reset not still connected to 0x55c14e69c680 2023-09-23T08:50:03.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c161860c30 2023-09-23T08:50:03.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c16af7ad00 2023-09-23T08:50:03.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c16b1040d0 2023-09-23T08:50:03.273 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.268+0000 7ff9e8051640 -1 reset not still connected to 0x55c16f3a6dd0 2023-09-23T08:50:03.294 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.288+0000 7ff9e8051640 -1 reset not still connected to 0x55c1859ad5f0 2023-09-23T08:50:03.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c142c26a90 2023-09-23T08:50:03.969 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.964+0000 7ff9e8051640 -1 reset not still connected to 0x55c14e69c680 2023-09-23T08:50:03.973 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.968+0000 7ff9e8051640 -1 reset not still connected to 0x55c161860c30 2023-09-23T08:50:04.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:03.996+0000 7ff9e8051640 -1 reset not still connected to 0x55c16af7ad00 2023-09-23T08:50:04.018 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:04.012+0000 7ff9e8051640 -1 reset not still connected to 0x55c16b1040d0 2023-09-23T08:50:04.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:04.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c16f3a6dd0 2023-09-23T08:50:04.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:04.020+0000 7ff9e8051640 -1 reset not still connected to 0x55c1859ad5f0 2023-09-23T08:50:04.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-09-23T08:50:05.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12b2da820 2023-09-23T08:50:05.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12bb25ad0 2023-09-23T08:50:05.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c12d7c9790 2023-09-23T08:50:05.119 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.112+0000 7ff9e8051640 -1 reset not still connected to 0x55c132fc3ad0 2023-09-23T08:50:05.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.144+0000 7ff9e8051640 -1 reset not still connected to 0x55c1372fa820 2023-09-23T08:50:05.154 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.148+0000 7ff9e8051640 -1 reset not still connected to 0x55c1380b1450 2023-09-23T08:50:05.170 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.160+0000 7ff9e8051640 -1 reset not still connected to 0x55c13895b860 2023-09-23T08:50:05.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c142c26a90 2023-09-23T08:50:05.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.168+0000 7ff9e8051640 -1 reset not still connected to 0x55c14e69c680 2023-09-23T08:50:05.175 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.172+0000 7ff9e8051640 -1 reset not still connected to 0x55c161860c30 2023-09-23T08:50:05.186 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.180+0000 7ff9e8051640 -1 reset not still connected to 0x55c16af7ad00 2023-09-23T08:50:05.197 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.192+0000 7ff9e8051640 -1 reset not still connected to 0x55c16b1040d0 2023-09-23T08:50:05.217 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.212+0000 7ff9e8051640 -1 reset not still connected to 0x55c16f3a6dd0 2023-09-23T08:50:05.227 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.224+0000 7ff9e8051640 -1 reset not still connected to 0x55c1859ad5f0 2023-09-23T08:50:05.269 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.264+0000 7ff9e8051640 -1 reset not still connected to 0x55c13895b860 2023-09-23T08:50:05.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.280+0000 7ff9e8051640 -1 reset not still connected to 0x55c161860c30 2023-09-23T08:50:05.300 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.292+0000 7ff9e8051640 -1 reset not still connected to 0x55c16af7ad00 2023-09-23T08:50:05.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.308+0000 7ff9e8051640 -1 reset not still connected to 0x55c16f3a6dd0 2023-09-23T08:50:05.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2023-09-23T08:50:05.320+0000 7ff9e8051640 -1 reset not still connected to 0x55c1859ad5f0 2023-09-23T08:50:06.014 INFO:tasks.ceph.osd.0:Stopped 2023-09-23T08:50:06.015 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-23T08:50:06.015 INFO:teuthology.orchestra.run:waiting for 300 2023-09-23T08:50:09.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-09-23T08:50:09.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-09-23T08:50:12.116 INFO:tasks.ceph.osd.1:Stopped 2023-09-23T08:50:12.117 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-23T08:50:12.117 INFO:teuthology.orchestra.run:waiting for 300 2023-09-23T08:50:14.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-09-23T08:50:14.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-09-23T08:50:18.219 INFO:tasks.ceph.osd.2:Stopped 2023-09-23T08:50:18.220 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-23T08:50:18.220 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-23T08:50:18.220 INFO:teuthology.orchestra.run:waiting for 300 2023-09-23T08:50:20.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-09-23T08:50:20.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-09-23T08:50:24.322 INFO:tasks.ceph.mgr.x:Stopped 2023-09-23T08:50:24.322 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-23T08:50:24.323 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-23T08:50:24.323 INFO:teuthology.orchestra.run:waiting for 300 2023-09-23T08:50:25.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-09-23T08:50:30.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-09-23T08:50:30.424 INFO:tasks.ceph.mon.a:Stopped 2023-09-23T08:50:30.425 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-23T08:50:30.425 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2023-09-23T08:50:30.515 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi107.front.sepia.ceph.com 2023-09-23T08:50:30.515 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-23T08:50:31.194 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi107.front.sepia.ceph.com 2023-09-23T08:50:31.194 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-23T08:50:31.948 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi107.front.sepia.ceph.com 2023-09-23T08:50:31.949 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-23T08:50:32.329 INFO:tasks.ceph:Archiving mon data... 2023-09-23T08:50:32.331 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi/7401660/data/mon.a.tgz 2023-09-23T08:50:32.331 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2023-09-23T08:50:32.336 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.QQXyAM7GWV 2023-09-23T08:50:32.336 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QQXyAM7GWV 2023-09-23T08:50:32.472 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.QQXyAM7GWV 2023-09-23T08:50:32.563 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.QQXyAM7GWV is 393KB 2023-09-23T08:50:32.637 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.QQXyAM7GWV 2023-09-23T08:50:32.648 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-23T08:50:32.649 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-23T08:50:32.726 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-23T08:50:32.727 DEBUG:teuthology.orchestra.run.smithi107:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-23T08:50:32.791 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-23T08:50:32.796 INFO:tasks.ceph:Archiving crash dumps... 2023-09-23T08:50:32.798 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi/7401660/remote/smithi107/crash 2023-09-23T08:50:32.799 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-23T08:50:32.850 INFO:tasks.ceph:Compressing logs... 2023-09-23T08:50:32.850 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-23T08:50:32.929 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45128.log 2023-09-23T08:50:32.931 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54153.log 2023-09-23T08:50:32.931 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41093.log 2023-09-23T08:50:32.932 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.54153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38650.log 2023-09-23T08:50:32.932 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54153.log.gz 2023-09-23T08:50:32.932 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42599.log 2023-09-23T08:50:32.932 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46986.log 2023-09-23T08:50:32.932 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.42599.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41582.log 2023-09-23T08:50:32.932 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42901.log 2023-09-23T08:50:32.933 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46530.log 2023-09-23T08:50:32.934 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42901.log: /var/log/ceph/ceph-client.admin.41582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47595.log 2023-09-23T08:50:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52176.log 2023-09-23T08:50:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47595.log: /var/log/ceph/ceph-client.admin.46530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47046.log 2023-09-23T08:50:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38866.log 2023-09-23T08:50:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52176.log.gz 2023-09-23T08:50:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54259.log 2023-09-23T08:50:32.935 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40870.log 2023-09-23T08:50:32.936 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38866.log: /var/log/ceph/ceph-client.admin.54259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53535.log 2023-09-23T08:50:32.936 INFO:teuthology.orchestra.run.smithi107.stderr: 29.0% -- replaced with /var/log/ceph/ceph-client.admin.54259.log.gz 2023-09-23T08:50:32.936 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38434.log 2023-09-23T08:50:32.941 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40870.log: /var/log/ceph/ceph-client.admin.53535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42106.log 2023-09-23T08:50:32.941 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47868.log 2023-09-23T08:50:32.941 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50846.log 2023-09-23T08:50:32.941 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42106.log: /var/log/ceph/ceph-client.admin.47868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53698.log 2023-09-23T08:50:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38633.log 2023-09-23T08:50:32.942 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50846.log.gz 2023-09-23T08:50:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38616.log 2023-09-23T08:50:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53698.log.gz 2023-09-23T08:50:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49909.log 2023-09-23T08:50:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39156.log 2023-09-23T08:50:32.942 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38269.log/var/log/ceph/ceph-client.admin.49909.log: 2023-09-23T08:50:32.943 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49909.log.gz 2023-09-23T08:50:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37436.log 2023-09-23T08:50:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47260.log 2023-09-23T08:50:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44580.log 2023-09-23T08:50:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37436.log: /var/log/ceph/ceph-client.admin.47260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37515.log 2023-09-23T08:50:32.943 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53941.log 2023-09-23T08:50:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44580.log: /var/log/ceph/ceph-client.admin.37515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45803.log 2023-09-23T08:50:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38920.log 2023-09-23T08:50:32.944 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53941.log.gz 2023-09-23T08:50:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53646.log 2023-09-23T08:50:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47474.log 2023-09-23T08:50:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41780.log 2023-09-23T08:50:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53646.log.gz 2023-09-23T08:50:32.944 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50701.log 2023-09-23T08:50:33.113 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46225.log 2023-09-23T08:50:33.113 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46347.log 2023-09-23T08:50:33.114 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38866.log.gz -- replaced with /var/log/ceph/ceph-client.admin.38434.log.gz 2023-09-23T08:50:33.114 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.114 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39156.log.gz 2023-09-23T08:50:33.114 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41582.log.gz 2023-09-23T08:50:33.114 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50701.log.gz 2023-09-23T08:50:33.114 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38633.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42599.log.gz 2023-09-23T08:50:33.115 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.115 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38269.log.gz 2023-09-23T08:50:33.115 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45128.log.gz 2023-09-23T08:50:33.115 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42106.log.gz 2023-09-23T08:50:33.115 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38616.log.gz 2023-09-23T08:50:33.116 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38650.log.gz -- replaced with /var/log/ceph/ceph-client.admin.40870.log.gz 2023-09-23T08:50:33.116 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.116 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41093.log.gz 2023-09-23T08:50:33.116 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52361.log 2023-09-23T08:50:33.116 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46530.log.gz 2023-09-23T08:50:33.116 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42901.log.gz -- replaced with /var/log/ceph/ceph-client.admin.47595.log.gz 2023-09-23T08:50:33.117 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.117 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46986.log.gz 2023-09-23T08:50:33.117 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47046.log.gz 2023-09-23T08:50:33.117 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47868.log.gz 2023-09-23T08:50:33.117 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46347.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47260.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46225.log.gz 2023-09-23T08:50:33.117 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.117 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44580.log.gz 2023-09-23T08:50:33.117 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45803.log.gz -- replaced with /var/log/ceph/ceph-client.admin.38920.log.gz 2023-09-23T08:50:33.118 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.118 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52046.log 2023-09-23T08:50:33.118 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47474.log.gz 2023-09-23T08:50:33.118 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46347.log.gz 2023-09-23T08:50:33.118 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41780.log.gz 2023-09-23T08:50:33.118 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48479.log 2023-09-23T08:50:33.118 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52361.log.gz 2023-09-23T08:50:33.118 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50521.log 2023-09-23T08:50:33.119 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52046.log.gz 2023-09-23T08:50:33.119 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53535.log.gz 2023-09-23T08:50:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51254.log 2023-09-23T08:50:33.119 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48479.log.gz 2023-09-23T08:50:33.119 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37436.log.gz 2023-09-23T08:50:33.119 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37515.log.gz 2023-09-23T08:50:33.119 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48293.log 2023-09-23T08:50:33.120 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50521.log.gz 2023-09-23T08:50:33.120 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51254.log.gz 2023-09-23T08:50:33.120 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44488.log 2023-09-23T08:50:33.120 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34346.log 2023-09-23T08:50:33.120 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48293.log.gz 2023-09-23T08:50:33.120 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38687.log 2023-09-23T08:50:33.120 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44488.log.gz 2023-09-23T08:50:33.121 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.34346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40901.log 2023-09-23T08:50:33.121 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34346.log.gz 2023-09-23T08:50:33.121 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49271.log 2023-09-23T08:50:33.121 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38687.log.gz 2023-09-23T08:50:33.121 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41313.log 2023-09-23T08:50:33.121 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40901.log.gz 2023-09-23T08:50:33.121 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39418.log 2023-09-23T08:50:33.121 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49271.log.gz 2023-09-23T08:50:33.122 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39244.log 2023-09-23T08:50:33.122 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41313.log.gz 2023-09-23T08:50:33.122 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38957.log 2023-09-23T08:50:33.122 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39418.log.gz 2023-09-23T08:50:33.122 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44947.log 2023-09-23T08:50:33.122 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39244.log.gz 2023-09-23T08:50:33.122 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53808.log 2023-09-23T08:50:33.123 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38957.log.gz 2023-09-23T08:50:33.123 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53372.log 2023-09-23T08:50:33.123 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44947.log.gz 2023-09-23T08:50:33.123 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37586.log 2023-09-23T08:50:33.123 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53808.log.gz 2023-09-23T08:50:33.123 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52551.log 2023-09-23T08:50:33.123 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53372.log.gz 2023-09-23T08:50:33.123 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45527.log 2023-09-23T08:50:33.124 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37586.log.gz 2023-09-23T08:50:33.124 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43884.log 2023-09-23T08:50:33.124 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52551.log.gz 2023-09-23T08:50:33.124 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48020.log 2023-09-23T08:50:33.124 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz 2023-09-23T08:50:33.124 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43884.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43884.log.gz -5 2023-09-23T08:50:33.124 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47138.log 2023-09-23T08:50:33.125 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40546.log 2023-09-23T08:50:33.125 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48020.log.gz 2023-09-23T08:50:33.125 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42166.log 2023-09-23T08:50:33.125 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47138.log.gz 2023-09-23T08:50:33.125 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40546.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-09-23T08:50:33.125 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40546.log.gz 2023-09-23T08:50:33.125 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38289.log 2023-09-23T08:50:33.125 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42166.log.gz 2023-09-23T08:50:33.126 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39977.log 2023-09-23T08:50:33.126 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48051.log 2023-09-23T08:50:33.126 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38289.log.gz 2023-09-23T08:50:33.126 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39048.log 2023-09-23T08:50:33.126 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39977.log.gz 2023-09-23T08:50:33.126 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52656.log 2023-09-23T08:50:33.126 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48051.log.gz 2023-09-23T08:50:33.126 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45315.log 2023-09-23T08:50:33.127 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39048.log.gz 2023-09-23T08:50:33.127 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49635.log 2023-09-23T08:50:33.127 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52656.log.gz 2023-09-23T08:50:33.127 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50900.log 2023-09-23T08:50:33.127 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45315.log.gz 2023-09-23T08:50:33.127 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38508.log 2023-09-23T08:50:33.127 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49635.log.gz 2023-09-23T08:50:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50900.log.gz 2023-09-23T08:50:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50610.log 2023-09-23T08:50:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47535.log 2023-09-23T08:50:33.128 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38508.log.gz 2023-09-23T08:50:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40747.log 2023-09-23T08:50:33.128 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50610.log.gz 2023-09-23T08:50:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48142.log 2023-09-23T08:50:33.128 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47535.log.gz 2023-09-23T08:50:33.129 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46438.log 2023-09-23T08:50:33.129 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40747.log.gz 2023-09-23T08:50:33.129 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48142.log.gz 2023-09-23T08:50:33.129 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46498.log 2023-09-23T08:50:33.129 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2023-09-23T08:50:33.129 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46438.log.gz 2023-09-23T08:50:33.129 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43485.log 2023-09-23T08:50:33.130 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46498.log.gz 2023-09-23T08:50:33.130 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50370.log 2023-09-23T08:50:33.130 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2023-09-23T08:50:33.130 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49301.log 2023-09-23T08:50:33.130 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43485.log.gz 2023-09-23T08:50:33.130 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38741.log 2023-09-23T08:50:33.130 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50370.log.gz 2023-09-23T08:50:33.130 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39102.log 2023-09-23T08:50:33.131 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49301.log.gz 2023-09-23T08:50:33.131 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54206.log 2023-09-23T08:50:33.131 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38741.log.gz 2023-09-23T08:50:33.131 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41424.log 2023-09-23T08:50:33.131 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39102.log.gz 2023-09-23T08:50:33.131 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.54206.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.54206.log.gz -- 2023-09-23T08:50:33.131 INFO:teuthology.orchestra.run.smithi107.stderr: /var/log/ceph/ceph-client.admin.46621.log 2023-09-23T08:50:33.131 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42575.log 2023-09-23T08:50:33.132 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41424.log.gz 2023-09-23T08:50:33.132 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40416.log 2023-09-23T08:50:33.132 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46621.log.gz 2023-09-23T08:50:33.132 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50955.log 2023-09-23T08:50:33.132 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42575.log.gz 2023-09-23T08:50:33.132 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49849.log 2023-09-23T08:50:33.132 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40416.log.gz 2023-09-23T08:50:33.132 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52894.log 2023-09-23T08:50:33.133 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50955.log.gz 2023-09-23T08:50:33.133 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49849.log.gz 2023-09-23T08:50:33.133 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47625.log 2023-09-23T08:50:33.133 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.52894.log: -- /var/log/ceph/ceph-client.admin.46286.log 2023-09-23T08:50:33.133 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52894.log.gz 2023-09-23T08:50:33.133 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48449.log 2023-09-23T08:50:33.133 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47625.log.gz 2023-09-23T08:50:33.134 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46286.log.gz 2023-09-23T08:50:33.134 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51491.log 2023-09-23T08:50:33.134 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48908.log 2023-09-23T08:50:33.134 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48449.log.gz 2023-09-23T08:50:33.134 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45225.log 2023-09-23T08:50:33.134 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51491.log.gz 2023-09-23T08:50:33.134 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48908.log.gz 2023-09-23T08:50:33.134 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51411.log 2023-09-23T08:50:33.135 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39762.log 2023-09-23T08:50:33.135 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45225.log.gz 2023-09-23T08:50:33.135 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39065.log 2023-09-23T08:50:33.135 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51411.log.gz 2023-09-23T08:50:33.135 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39762.log.gz 2023-09-23T08:50:33.135 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40627.log 2023-09-23T08:50:33.135 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40935.log/var/log/ceph/ceph-client.admin.39065.log: 2023-09-23T08:50:33.135 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39065.log.gz 2023-09-23T08:50:33.136 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43281.log 2023-09-23T08:50:33.136 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40627.log.gz 2023-09-23T08:50:33.136 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50029.log 2023-09-23T08:50:33.136 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40935.log.gz 2023-09-23T08:50:33.136 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53159.log 2023-09-23T08:50:33.136 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43281.log.gz 2023-09-23T08:50:33.136 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48968.log 2023-09-23T08:50:33.137 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50029.log.gz 2023-09-23T08:50:33.137 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50936.log 2023-09-23T08:50:33.137 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53159.log.gz 2023-09-23T08:50:33.137 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52972.log 2023-09-23T08:50:33.137 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48968.log.gz 2023-09-23T08:50:33.137 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50936.log.gz 2023-09-23T08:50:33.137 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53887.log 2023-09-23T08:50:33.138 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49089.log 2023-09-23T08:50:33.138 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52972.log.gz 2023-09-23T08:50:33.138 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53887.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.48539.log -- replaced with /var/log/ceph/ceph-client.admin.53887.log.gz 2023-09-23T08:50:33.138 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.138 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53503.log 2023-09-23T08:50:33.138 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49089.log.gz 2023-09-23T08:50:33.138 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2023-09-23T08:50:33.139 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48539.log.gz 2023-09-23T08:50:33.139 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39281.log 2023-09-23T08:50:33.139 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53503.log.gz 2023-09-23T08:50:33.139 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42626.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2023-09-23T08:50:33.139 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38235.log 2023-09-23T08:50:33.139 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42196.log 2023-09-23T08:50:33.139 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39281.log.gz 2023-09-23T08:50:33.139 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50628.log 2023-09-23T08:50:33.140 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38235.log.gz 2023-09-23T08:50:33.140 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42196.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.42196.log.gz --verbose 2023-09-23T08:50:33.140 INFO:teuthology.orchestra.run.smithi107.stderr: -- /var/log/ceph/ceph-client.admin.51097.log 2023-09-23T08:50:33.140 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53861.log 2023-09-23T08:50:33.140 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50628.log.gz 2023-09-23T08:50:33.140 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54127.log 2023-09-23T08:50:33.140 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51097.log.gz 2023-09-23T08:50:33.140 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44917.log 2023-09-23T08:50:33.141 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53861.log.gz 2023-09-23T08:50:33.141 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.54127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50664.log 2023-09-23T08:50:33.141 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54127.log.gz 2023-09-23T08:50:33.141 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44917.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.44917.log.gz /var/log/ceph/ceph-client.admin.45285.log 2023-09-23T08:50:33.141 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.141 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38400.log 2023-09-23T08:50:33.141 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50664.log.gz 2023-09-23T08:50:33.142 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45285.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30694.log 2023-09-23T08:50:33.142 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45285.log.gz 2023-09-23T08:50:33.142 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2023-09-23T08:50:33.142 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38400.log.gz 2023-09-23T08:50:33.142 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.tmp-client.admin.30694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47016.log 2023-09-23T08:50:33.142 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30694.log.gz 2023-09-23T08:50:33.142 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46316.log 2023-09-23T08:50:33.143 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2023-09-23T08:50:33.143 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47016.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.47016.log.gz /var/log/ceph/ceph-client.admin.34491.log 2023-09-23T08:50:33.143 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.143 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45773.log 2023-09-23T08:50:33.143 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46316.log.gz 2023-09-23T08:50:33.143 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.34491.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-09-23T08:50:33.143 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34491.log.gz 2023-09-23T08:50:33.143 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49331.log 2023-09-23T08:50:33.144 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45773.log.gz 2023-09-23T08:50:33.144 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38579.log 2023-09-23T08:50:33.144 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46772.log 2023-09-23T08:50:33.144 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49331.log.gz 2023-09-23T08:50:33.144 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47806.log 2023-09-23T08:50:33.144 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38579.log.gz 2023-09-23T08:50:33.144 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46772.log.gz 2023-09-23T08:50:33.145 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53782.log 2023-09-23T08:50:33.145 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45682.log 2023-09-23T08:50:33.145 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47806.log.gz 2023-09-23T08:50:33.145 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40266.log 2023-09-23T08:50:33.145 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53782.log.gz 2023-09-23T08:50:33.145 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51385.log 2023-09-23T08:50:33.145 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45682.log.gz 2023-09-23T08:50:33.145 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38525.log 2023-09-23T08:50:33.146 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40266.log.gz 2023-09-23T08:50:33.146 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49575.log 2023-09-23T08:50:33.146 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51385.log.gz 2023-09-23T08:50:33.146 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45435.log 2023-09-23T08:50:33.146 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38525.log.gz 2023-09-23T08:50:33.146 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43067.log 2023-09-23T08:50:33.146 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49575.log.gz 2023-09-23T08:50:33.147 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42747.log 2023-09-23T08:50:33.147 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45435.log.gz 2023-09-23T08:50:33.147 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49665.log 2023-09-23T08:50:33.147 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43067.log.gz 2023-09-23T08:50:33.147 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37240.log 2023-09-23T08:50:33.147 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42747.log.gz 2023-09-23T08:50:33.147 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38417.log 2023-09-23T08:50:33.147 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49665.log.gz 2023-09-23T08:50:33.148 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.37240.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49362.log 2023-09-23T08:50:33.148 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37240.log.gz 2023-09-23T08:50:33.148 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48570.log 2023-09-23T08:50:33.148 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38417.log.gz 2023-09-23T08:50:33.148 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2023-09-23T08:50:33.148 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49362.log.gz 2023-09-23T08:50:33.148 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52124.log 2023-09-23T08:50:33.148 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48570.log.gz 2023-09-23T08:50:33.149 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.34429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2023-09-23T08:50:33.149 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52998.log 2023-09-23T08:50:33.149 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37594.log 2023-09-23T08:50:33.149 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52124.log.gz 2023-09-23T08:50:33.149 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52998.log.gz 2023-09-23T08:50:33.149 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48202.log 2023-09-23T08:50:33.149 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42547.log 2023-09-23T08:50:33.149 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37594.log.gz 2023-09-23T08:50:33.150 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48202.log.gz 2023-09-23T08:50:33.150 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43914.log 2023-09-23T08:50:33.150 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37590.log 2023-09-23T08:50:33.150 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42547.log.gz 2023-09-23T08:50:33.150 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43914.log.gz 2023-09-23T08:50:33.150 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38326.log 2023-09-23T08:50:33.150 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51702.log 2023-09-23T08:50:33.151 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37590.log.gz 2023-09-23T08:50:33.151 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38326.log.gz 2023-09-23T08:50:33.151 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40073.log 2023-09-23T08:50:33.151 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2023-09-23T08:50:33.151 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51702.log.gz 2023-09-23T08:50:33.151 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40073.log.gz 2023-09-23T08:50:33.151 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38903.log 2023-09-23T08:50:33.151 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37716.log 2023-09-23T08:50:33.152 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2023-09-23T08:50:33.152 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52020.log 2023-09-23T08:50:33.152 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38903.log.gz 2023-09-23T08:50:33.152 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37716.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-09-23T08:50:33.152 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37716.log.gz 2023-09-23T08:50:33.152 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52020.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.52020.log.gz 2023-09-23T08:50:33.152 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52604.log 2023-09-23T08:50:33.153 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54101.log 2023-09-23T08:50:33.153 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52604.log.gz 2023-09-23T08:50:33.153 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39934.log 2023-09-23T08:50:33.153 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.54101.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2023-09-23T08:50:33.153 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54101.log.gz 2023-09-23T08:50:33.153 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39934.log.gz 2023-09-23T08:50:33.153 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42994.log 2023-09-23T08:50:33.153 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46135.log 2023-09-23T08:50:33.154 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2023-09-23T08:50:33.154 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42994.log.gz 2023-09-23T08:50:33.154 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40819.log 2023-09-23T08:50:33.154 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51201.log 2023-09-23T08:50:33.154 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46135.log.gz 2023-09-23T08:50:33.154 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40819.log.gz 2023-09-23T08:50:33.154 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37690.log 2023-09-23T08:50:33.155 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49513.log 2023-09-23T08:50:33.155 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51201.log.gz 2023-09-23T08:50:33.155 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38849.log 2023-09-23T08:50:33.155 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37690.log.gz 2023-09-23T08:50:33.155 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44246.log 2023-09-23T08:50:33.155 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49513.log.gz 2023-09-23T08:50:33.155 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51916.log 2023-09-23T08:50:33.155 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38849.log.gz 2023-09-23T08:50:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53592.log 2023-09-23T08:50:33.156 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44246.log.gz 2023-09-23T08:50:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47443.log 2023-09-23T08:50:33.156 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51916.log.gz 2023-09-23T08:50:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53592.log.gz 2023-09-23T08:50:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50738.log 2023-09-23T08:50:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47443.log.gz 2023-09-23T08:50:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38724.log 2023-09-23T08:50:33.157 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48817.log 2023-09-23T08:50:33.157 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50738.log.gz 2023-09-23T08:50:33.157 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38724.log.gz 2023-09-23T08:50:33.157 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43974.log 2023-09-23T08:50:33.157 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42021.log 2023-09-23T08:50:33.157 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48817.log.gz 2023-09-23T08:50:33.157 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43974.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.43974.log.gz -- 2023-09-23T08:50:33.158 INFO:teuthology.orchestra.run.smithi107.stderr: /var/log/ceph/ceph-client.admin.54179.log 2023-09-23T08:50:33.158 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46835.log 2023-09-23T08:50:33.158 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42021.log.gz 2023-09-23T08:50:33.158 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.54179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54179.log.gz 2023-09-23T08:50:33.158 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48757.log 2023-09-23T08:50:33.158 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53424.log 2023-09-23T08:50:33.158 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46835.log.gz 2023-09-23T08:50:33.158 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47686.log 2023-09-23T08:50:33.159 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48757.log.gz 2023-09-23T08:50:33.159 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41981.log 2023-09-23T08:50:33.159 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53424.log.gz 2023-09-23T08:50:33.159 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41364.log 2023-09-23T08:50:33.159 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47686.log.gz 2023-09-23T08:50:33.159 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40574.log 2023-09-23T08:50:33.159 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41981.log.gz 2023-09-23T08:50:33.159 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49392.log 2023-09-23T08:50:33.160 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41364.log.gz 2023-09-23T08:50:33.160 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2023-09-23T08:50:33.160 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40574.log.gz 2023-09-23T08:50:33.160 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46896.log 2023-09-23T08:50:33.160 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49392.log.gz 2023-09-23T08:50:33.160 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45621.log 2023-09-23T08:50:33.160 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2023-09-23T08:50:33.161 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38454.log 2023-09-23T08:50:33.161 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46896.log.gz 2023-09-23T08:50:33.161 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53133.log 2023-09-23T08:50:33.161 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45621.log.gz 2023-09-23T08:50:33.161 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44795.log 2023-09-23T08:50:33.161 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38454.log.gz 2023-09-23T08:50:33.161 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50882.log 2023-09-23T08:50:33.161 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53133.log.gz 2023-09-23T08:50:33.162 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44825.log 2023-09-23T08:50:33.162 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44795.log.gz 2023-09-23T08:50:33.162 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42717.log 2023-09-23T08:50:33.162 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50882.log.gz 2023-09-23T08:50:33.162 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50646.log 2023-09-23T08:50:33.162 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44825.log.gz 2023-09-23T08:50:33.162 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53996.log 2023-09-23T08:50:33.162 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42717.log.gz 2023-09-23T08:50:33.163 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50646.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50646.log.gz -5 2023-09-23T08:50:33.163 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53213.log 2023-09-23T08:50:33.163 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51520.log 2023-09-23T08:50:33.163 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53996.log.gz 2023-09-23T08:50:33.163 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50864.log 2023-09-23T08:50:33.163 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53213.log.gz 2023-09-23T08:50:33.163 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38471.log 2023-09-23T08:50:33.163 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51520.log.gz 2023-09-23T08:50:33.164 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39805.log 2023-09-23T08:50:33.164 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50864.log.gz 2023-09-23T08:50:33.164 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51464.log 2023-09-23T08:50:33.164 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38471.log.gz 2023-09-23T08:50:33.164 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49787.log 2023-09-23T08:50:33.164 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39805.log.gz 2023-09-23T08:50:33.164 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44550.log 2023-09-23T08:50:33.165 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51464.log.gz 2023-09-23T08:50:33.165 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41180.log 2023-09-23T08:50:33.165 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49787.log.gz 2023-09-23T08:50:33.165 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37404.log 2023-09-23T08:50:33.165 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44550.log.gz 2023-09-23T08:50:33.165 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43515.log 2023-09-23T08:50:33.165 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41180.log.gz 2023-09-23T08:50:33.165 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41210.log 2023-09-23T08:50:33.166 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37404.log.gz 2023-09-23T08:50:33.166 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45194.log 2023-09-23T08:50:33.166 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43515.log.gz 2023-09-23T08:50:33.166 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50336.log 2023-09-23T08:50:33.166 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41210.log.gz 2023-09-23T08:50:33.166 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46195.log 2023-09-23T08:50:33.166 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45194.log.gz 2023-09-23T08:50:33.167 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42380.log 2023-09-23T08:50:33.167 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50336.log.gz 2023-09-23T08:50:33.167 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43671.log 2023-09-23T08:50:33.167 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46195.log.gz 2023-09-23T08:50:33.167 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41890.log 2023-09-23T08:50:33.167 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42380.log.gz 2023-09-23T08:50:33.167 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51676.log 2023-09-23T08:50:33.167 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43671.log.gz 2023-09-23T08:50:33.168 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44004.log 2023-09-23T08:50:33.168 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41890.log.gz 2023-09-23T08:50:33.168 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45588.log 2023-09-23T08:50:33.168 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51676.log.gz 2023-09-23T08:50:33.168 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45158.log 2023-09-23T08:50:33.168 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44004.log.gz 2023-09-23T08:50:33.168 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38218.log 2023-09-23T08:50:33.168 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45588.log.gz 2023-09-23T08:50:33.169 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47776.log 2023-09-23T08:50:33.169 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45158.log.gz 2023-09-23T08:50:33.169 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47230.log 2023-09-23T08:50:33.169 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38218.log.gz 2023-09-23T08:50:33.169 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54283.log 2023-09-23T08:50:33.169 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47776.log.gz 2023-09-23T08:50:33.169 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43313.log 2023-09-23T08:50:33.169 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47230.log.gz 2023-09-23T08:50:33.170 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.54283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52786.log 2023-09-23T08:50:33.170 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54283.log.gz 2023-09-23T08:50:33.170 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43313.log.gz 2023-09-23T08:50:33.170 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42441.log 2023-09-23T08:50:33.170 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53672.log 2023-09-23T08:50:33.170 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52786.log.gz 2023-09-23T08:50:33.170 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38380.log 2023-09-23T08:50:33.171 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42441.log.gz 2023-09-23T08:50:33.171 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.53672.log: /var/log/ceph/ceph-client.admin.41644.log 2023-09-23T08:50:33.171 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53672.log.gz 2023-09-23T08:50:33.171 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42300.log 2023-09-23T08:50:33.171 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38380.log.gz 2023-09-23T08:50:33.171 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50152.log 2023-09-23T08:50:33.171 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41644.log.gz 2023-09-23T08:50:33.171 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51572.log 2023-09-23T08:50:33.172 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42300.log.gz 2023-09-23T08:50:33.172 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52946.log 2023-09-23T08:50:33.172 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50152.log.gz 2023-09-23T08:50:33.172 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45712.log 2023-09-23T08:50:33.172 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51572.log.gz 2023-09-23T08:50:33.172 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39190.log 2023-09-23T08:50:33.172 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52946.log.gz 2023-09-23T08:50:33.173 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50122.log 2023-09-23T08:50:33.173 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45712.log.gz 2023-09-23T08:50:33.173 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50974.log 2023-09-23T08:50:33.173 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39190.log.gz 2023-09-23T08:50:33.173 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50792.log 2023-09-23T08:50:33.173 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50122.log.gz 2023-09-23T08:50:33.173 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39718.log 2023-09-23T08:50:33.173 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50974.log.gz 2023-09-23T08:50:33.174 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50792.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.50792.log.gz --verbose 2023-09-23T08:50:33.174 INFO:teuthology.orchestra.run.smithi107.stderr: -- /var/log/ceph/ceph-client.admin.53619.log 2023-09-23T08:50:33.174 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38795.log 2023-09-23T08:50:33.174 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39718.log.gz 2023-09-23T08:50:33.174 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.53619.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49545.log 2023-09-23T08:50:33.174 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53619.log.gz 2023-09-23T08:50:33.174 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2023-09-23T08:50:33.175 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38795.log.gz 2023-09-23T08:50:33.175 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44034.log 2023-09-23T08:50:33.175 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49545.log.gz 2023-09-23T08:50:33.175 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44065.log 2023-09-23T08:50:33.175 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2023-09-23T08:50:33.175 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46105.log 2023-09-23T08:50:33.175 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44034.log.gz 2023-09-23T08:50:33.175 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52443.log 2023-09-23T08:50:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44065.log.gz 2023-09-23T08:50:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44734.log 2023-09-23T08:50:33.176 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46105.log.gz 2023-09-23T08:50:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51438.log 2023-09-23T08:50:33.176 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52443.log.gz 2023-09-23T08:50:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40303.log 2023-09-23T08:50:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44734.log.gz 2023-09-23T08:50:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43091.log 2023-09-23T08:50:33.177 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51438.log.gz 2023-09-23T08:50:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40303.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.43337.log -- replaced with /var/log/ceph/ceph-client.admin.40303.log.gz 2023-09-23T08:50:33.177 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43118.log 2023-09-23T08:50:33.177 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43091.log.gz 2023-09-23T08:50:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40843.log 2023-09-23T08:50:33.177 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43337.log.gz 2023-09-23T08:50:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43118.log.gz 2023-09-23T08:50:33.178 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52523.log 2023-09-23T08:50:33.178 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51011.log 2023-09-23T08:50:33.178 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40843.log.gz 2023-09-23T08:50:33.178 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47928.log 2023-09-23T08:50:33.178 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52523.log.gz 2023-09-23T08:50:33.178 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51890.log 2023-09-23T08:50:33.178 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51011.log.gz 2023-09-23T08:50:33.178 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2023-09-23T08:50:33.179 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47928.log.gz 2023-09-23T08:50:33.179 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50918.log 2023-09-23T08:50:33.179 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51890.log.gz 2023-09-23T08:50:33.179 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40446.log 2023-09-23T08:50:33.179 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2023-09-23T08:50:33.179 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45924.log 2023-09-23T08:50:33.179 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50918.log.gz 2023-09-23T08:50:33.180 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50720.log 2023-09-23T08:50:33.180 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40446.log.gz 2023-09-23T08:50:33.180 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44125.log 2023-09-23T08:50:33.180 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45924.log.gz 2023-09-23T08:50:33.180 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42410.log 2023-09-23T08:50:33.180 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50720.log.gz 2023-09-23T08:50:33.180 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53914.log 2023-09-23T08:50:33.180 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44125.log.gz 2023-09-23T08:50:33.181 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43761.log 2023-09-23T08:50:33.181 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42410.log.gz 2023-09-23T08:50:33.181 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47291.log 2023-09-23T08:50:33.181 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53914.log.gz 2023-09-23T08:50:33.181 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52842.log 2023-09-23T08:50:33.181 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43761.log.gz 2023-09-23T08:50:33.181 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46652.log 2023-09-23T08:50:33.181 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47291.log.gz 2023-09-23T08:50:33.182 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41281.log 2023-09-23T08:50:33.182 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52842.log.gz 2023-09-23T08:50:33.182 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41150.log 2023-09-23T08:50:33.182 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46652.log.gz 2023-09-23T08:50:33.182 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54048.log 2023-09-23T08:50:33.182 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41281.log.gz 2023-09-23T08:50:33.182 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45651.log 2023-09-23T08:50:33.183 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41150.log.gz 2023-09-23T08:50:33.183 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.54048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38542.log 2023-09-23T08:50:33.183 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54048.log.gz 2023-09-23T08:50:33.183 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48419.log 2023-09-23T08:50:33.183 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45651.log.gz 2023-09-23T08:50:33.183 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44887.log 2023-09-23T08:50:33.183 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38542.log.gz 2023-09-23T08:50:33.183 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53106.log 2023-09-23T08:50:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48419.log.gz 2023-09-23T08:50:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53024.log 2023-09-23T08:50:33.184 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44887.log.gz 2023-09-23T08:50:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52868.log 2023-09-23T08:50:33.184 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53106.log.gz 2023-09-23T08:50:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.53024.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48509.log 2023-09-23T08:50:33.184 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53024.log.gz 2023-09-23T08:50:33.184 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41705.log 2023-09-23T08:50:33.185 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52868.log.gz 2023-09-23T08:50:33.185 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52307.log 2023-09-23T08:50:33.185 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48509.log.gz 2023-09-23T08:50:33.185 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41705.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-09-23T08:50:33.185 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41705.log.gz 2023-09-23T08:50:33.185 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39451.log 2023-09-23T08:50:33.185 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52307.log.gz 2023-09-23T08:50:33.185 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47411.log 2023-09-23T08:50:33.186 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39451.log: -- /var/log/ceph/ceph-client.admin.42352.log 2023-09-23T08:50:33.186 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39451.log.gz 2023-09-23T08:50:33.186 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38974.log 2023-09-23T08:50:33.186 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47411.log.gz 2023-09-23T08:50:33.186 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45984.log 2023-09-23T08:50:33.186 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42352.log.gz 2023-09-23T08:50:33.186 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50582.log 2023-09-23T08:50:33.187 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38974.log.gz 2023-09-23T08:50:33.187 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39385.log 2023-09-23T08:50:33.187 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45984.log.gz 2023-09-23T08:50:33.187 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48726.log 2023-09-23T08:50:33.187 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50582.log.gz 2023-09-23T08:50:33.187 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5/var/log/ceph/ceph-client.admin.39385.log: --verbose -- /var/log/ceph/ceph-client.admin.44095.log 2023-09-23T08:50:33.187 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39385.log.gz 2023-09-23T08:50:33.187 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46956.log 2023-09-23T08:50:33.188 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48726.log.gz 2023-09-23T08:50:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38758.log 2023-09-23T08:50:33.188 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44095.log.gz 2023-09-23T08:50:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50993.log 2023-09-23T08:50:33.188 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46956.log.gz 2023-09-23T08:50:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42328.log 2023-09-23T08:50:33.188 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38758.log.gz 2023-09-23T08:50:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50552.log 2023-09-23T08:50:33.189 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50993.log.gz 2023-09-23T08:50:33.189 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gz 2023-09-23T08:50:33.189 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51048.log 2023-09-23T08:50:33.189 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44216.log 2023-09-23T08:50:33.189 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50552.log.gz 2023-09-23T08:50:33.189 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51048.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51048.log.gz -5 2023-09-23T08:50:33.189 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47565.log 2023-09-23T08:50:33.190 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47351.log 2023-09-23T08:50:33.190 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44216.log.gz 2023-09-23T08:50:33.190 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39298.log 2023-09-23T08:50:33.190 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47565.log.gz 2023-09-23T08:50:33.190 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38778.log 2023-09-23T08:50:33.190 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47351.log.gz 2023-09-23T08:50:33.190 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50214.log 2023-09-23T08:50:33.190 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39298.log.gz 2023-09-23T08:50:33.191 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43455.log 2023-09-23T08:50:33.191 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38778.log.gz 2023-09-23T08:50:33.191 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51834.log 2023-09-23T08:50:33.191 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50214.log.gz 2023-09-23T08:50:33.191 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39587.log 2023-09-23T08:50:33.191 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43455.log.gz 2023-09-23T08:50:33.191 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39173.log 2023-09-23T08:50:33.193 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51834.log.gz 2023-09-23T08:50:33.193 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40476.log 2023-09-23T08:50:33.193 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39587.log.gz 2023-09-23T08:50:33.193 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45863.log 2023-09-23T08:50:33.193 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39173.log.gz 2023-09-23T08:50:33.193 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42843.log 2023-09-23T08:50:33.194 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40476.log.gz 2023-09-23T08:50:33.194 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2023-09-23T08:50:33.194 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45863.log.gz 2023-09-23T08:50:33.194 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49999.log 2023-09-23T08:50:33.194 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42843.log.gz 2023-09-23T08:50:33.194 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51071.log 2023-09-23T08:50:33.194 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2023-09-23T08:50:33.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51650.log 2023-09-23T08:50:33.195 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49999.log.gz 2023-09-23T08:50:33.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53293.log 2023-09-23T08:50:33.195 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51071.log.gz 2023-09-23T08:50:33.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39891.log 2023-09-23T08:50:33.195 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51650.log.gz 2023-09-23T08:50:33.195 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53450.log 2023-09-23T08:50:33.195 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53293.log.gz 2023-09-23T08:50:33.196 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.39891.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45497.log 2023-09-23T08:50:33.196 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39891.log.gz 2023-09-23T08:50:33.196 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43425.log 2023-09-23T08:50:33.196 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53450.log.gz 2023-09-23T08:50:33.196 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46014.log 2023-09-23T08:50:33.196 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45497.log.gz 2023-09-23T08:50:33.196 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2023-09-23T08:50:33.196 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43425.log.gz 2023-09-23T08:50:33.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47108.log 2023-09-23T08:50:33.197 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46014.log.gz 2023-09-23T08:50:33.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51782.log 2023-09-23T08:50:33.197 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2023-09-23T08:50:33.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37352.log 2023-09-23T08:50:33.197 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47108.log.gz 2023-09-23T08:50:33.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43148.log 2023-09-23T08:50:33.198 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51782.log.gz 2023-09-23T08:50:33.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50092.log 2023-09-23T08:50:33.198 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37352.log.gz 2023-09-23T08:50:33.198 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51332.log 2023-09-23T08:50:33.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43148.log.gz 2023-09-23T08:50:33.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37516.log 2023-09-23T08:50:33.198 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50092.log.gz 2023-09-23T08:50:33.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42870.log 2023-09-23T08:50:33.199 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51332.log.gz 2023-09-23T08:50:33.199 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52760.log 2023-09-23T08:50:33.199 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37516.log.gz 2023-09-23T08:50:33.199 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51942.log 2023-09-23T08:50:33.199 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42870.log.gz 2023-09-23T08:50:33.199 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38309.log 2023-09-23T08:50:33.199 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52760.log.gz 2023-09-23T08:50:33.199 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38812.log 2023-09-23T08:50:33.200 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51942.log.gz 2023-09-23T08:50:33.200 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52815.log 2023-09-23T08:50:33.200 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38309.log.gz 2023-09-23T08:50:33.200 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53968.log 2023-09-23T08:50:33.200 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38812.log.gz 2023-09-23T08:50:33.200 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34252.log 2023-09-23T08:50:33.200 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52815.log.gz 2023-09-23T08:50:33.201 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46407.log 2023-09-23T08:50:33.201 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53968.log.gz 2023-09-23T08:50:33.201 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.34252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50245.log 2023-09-23T08:50:33.201 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34252.log.gz 2023-09-23T08:50:33.201 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38886.log 2023-09-23T08:50:33.201 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46407.log.gz 2023-09-23T08:50:33.201 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49483.log 2023-09-23T08:50:33.201 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50245.log.gz 2023-09-23T08:50:33.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53345.log 2023-09-23T08:50:33.202 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38886.log.gz 2023-09-23T08:50:33.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49483.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-09-23T08:50:33.202 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49483.log.gz 2023-09-23T08:50:33.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39676.log 2023-09-23T08:50:33.202 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53345.log.gz 2023-09-23T08:50:33.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51598.log 2023-09-23T08:50:33.202 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40966.log 2023-09-23T08:50:33.203 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39676.log.gz 2023-09-23T08:50:33.203 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50682.log 2023-09-23T08:50:33.203 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51598.log.gz 2023-09-23T08:50:33.203 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34370.log 2023-09-23T08:50:33.203 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40966.log.gz 2023-09-23T08:50:33.203 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50682.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.50682.log.gz 2023-09-23T08:50:33.203 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41394.log 2023-09-23T08:50:33.204 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.34370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39082.log 2023-09-23T08:50:33.204 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34370.log.gz 2023-09-23T08:50:33.204 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41558.log 2023-09-23T08:50:33.204 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41394.log.gz 2023-09-23T08:50:33.204 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45098.log 2023-09-23T08:50:33.204 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39082.log.gz 2023-09-23T08:50:33.204 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52072.log 2023-09-23T08:50:33.204 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41558.log.gz 2023-09-23T08:50:33.205 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41069.log 2023-09-23T08:50:33.205 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45098.log.gz 2023-09-23T08:50:33.205 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52414.log 2023-09-23T08:50:33.205 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52072.log.gz 2023-09-23T08:50:33.205 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53050.log 2023-09-23T08:50:33.205 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41069.log.gz 2023-09-23T08:50:33.205 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42932.log 2023-09-23T08:50:33.205 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52414.log.gz 2023-09-23T08:50:33.206 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2023-09-23T08:50:33.206 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53050.log.gz 2023-09-23T08:50:33.206 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45375.log 2023-09-23T08:50:33.206 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42932.log.gz 2023-09-23T08:50:33.206 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44428.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-23T08:50:33.206 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2023-09-23T08:50:33.206 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43179.log 2023-09-23T08:50:33.207 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45375.log.gz 2023-09-23T08:50:33.207 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39136.log 2023-09-23T08:50:33.207 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.43179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52203.log 2023-09-23T08:50:33.207 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43179.log.gz 2023-09-23T08:50:33.207 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42791.log 0.0% 2023-09-23T08:50:33.207 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39136.log.gz 2023-09-23T08:50:33.207 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48938.log 2023-09-23T08:50:33.207 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52203.log.gz 2023-09-23T08:50:33.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40657.log 2023-09-23T08:50:33.208 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42791.log.gz 2023-09-23T08:50:33.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54022.log 2023-09-23T08:50:33.208 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48938.log.gz 2023-09-23T08:50:33.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52150.log 2023-09-23T08:50:33.208 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40657.log.gz 2023-09-23T08:50:33.208 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.54022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44186.log 2023-09-23T08:50:33.208 INFO:teuthology.orchestra.run.smithi107.stderr: 29.5% -- replaced with /var/log/ceph/ceph-client.admin.54022.log.gz 2023-09-23T08:50:33.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52630.log 2023-09-23T08:50:33.209 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52150.log.gz 2023-09-23T08:50:33.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44337.log 2023-09-23T08:50:33.209 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44186.log.gz 2023-09-23T08:50:33.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53239.log 2023-09-23T08:50:33.209 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52630.log.gz 2023-09-23T08:50:33.209 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54074.log 2023-09-23T08:50:33.209 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44337.log.gz 2023-09-23T08:50:33.210 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43210.log 2023-09-23T08:50:33.210 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53239.log.gz 2023-09-23T08:50:33.210 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.54074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49119.log 2023-09-23T08:50:33.210 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54074.log.gz 2023-09-23T08:50:33.210 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41337.log 2023-09-23T08:50:33.210 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43210.log.gz 2023-09-23T08:50:33.210 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49119.log.gz 2023-09-23T08:50:33.211 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39011.log 2023-09-23T08:50:33.211 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41337.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41337.log.gz 2023-09-23T08:50:33.211 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47169.log 2023-09-23T08:50:33.211 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44641.log 2023-09-23T08:50:33.211 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39011.log.gz 2023-09-23T08:50:33.211 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47169.log.gz 2023-09-23T08:50:33.211 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46712.log 2023-09-23T08:50:33.211 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44764.log 2023-09-23T08:50:33.212 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44641.log.gz 2023-09-23T08:50:33.212 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44855.log 2023-09-23T08:50:33.212 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46712.log.gz 2023-09-23T08:50:33.212 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40506.log 2023-09-23T08:50:33.212 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44764.log.gz 2023-09-23T08:50:33.212 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44855.log.gz 2023-09-23T08:50:33.212 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52098.log 2023-09-23T08:50:33.212 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44397.log 2023-09-23T08:50:33.213 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40506.log.gz 2023-09-23T08:50:33.213 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52098.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.41240.log 2023-09-23T08:50:33.213 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52098.log.gz 2023-09-23T08:50:33.213 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2023-09-23T08:50:33.213 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44397.log.gz 2023-09-23T08:50:33.213 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47078.log 2023-09-23T08:50:33.213 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41240.log.gz 2023-09-23T08:50:33.214 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41951.log 2023-09-23T08:50:33.214 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2023-09-23T08:50:33.214 INFO:teuthology.orchestra.run.smithi107.stderr: 89.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-23T08:50:33.214 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39318.log 2023-09-23T08:50:33.214 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47078.log.gz 2023-09-23T08:50:33.214 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42136.log 2023-09-23T08:50:33.214 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41951.log.gz 2023-09-23T08:50:33.214 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49969.log 2023-09-23T08:50:33.215 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39318.log.gz 2023-09-23T08:50:33.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38252.log 2023-09-23T08:50:33.215 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42136.log.gz 2023-09-23T08:50:33.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50430.log 2023-09-23T08:50:33.215 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49969.log.gz 2023-09-23T08:50:33.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49059.log 2023-09-23T08:50:33.215 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38252.log.gz 2023-09-23T08:50:33.215 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51306.log 2023-09-23T08:50:33.216 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50430.log.gz 2023-09-23T08:50:33.216 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45465.log 2023-09-23T08:50:33.216 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49059.log.gz 2023-09-23T08:50:33.216 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45255.log 2023-09-23T08:50:33.216 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51306.log.gz 2023-09-23T08:50:33.216 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39545.log 2023-09-23T08:50:33.216 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45465.log.gz 2023-09-23T08:50:33.217 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47321.log 2023-09-23T08:50:33.217 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45255.log.gz 2023-09-23T08:50:33.217 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52682.log 2023-09-23T08:50:33.217 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39545.log.gz 2023-09-23T08:50:33.217 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51228.log 2023-09-23T08:50:33.217 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47321.log.gz 2023-09-23T08:50:33.217 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40717.log 2023-09-23T08:50:33.217 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52682.log.gz 2023-09-23T08:50:33.218 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53751.log 2023-09-23T08:50:33.218 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51228.log.gz 2023-09-23T08:50:33.218 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44306.log 2023-09-23T08:50:33.218 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40717.log.gz 2023-09-23T08:50:33.218 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48387.log 2023-09-23T08:50:33.218 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53751.log.gz 2023-09-23T08:50:33.218 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49453.log 2023-09-23T08:50:33.219 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44306.log.gz 2023-09-23T08:50:33.219 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43640.log 2023-09-23T08:50:33.219 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48387.log.gz 2023-09-23T08:50:33.219 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49727.log 2023-09-23T08:50:33.219 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49453.log.gz 2023-09-23T08:50:33.219 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41041.log 2023-09-23T08:50:33.219 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43640.log.gz 2023-09-23T08:50:33.220 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50306.log 2023-09-23T08:50:33.220 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49727.log.gz 2023-09-23T08:50:33.220 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52578.log 2023-09-23T08:50:33.220 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41041.log.gz 2023-09-23T08:50:33.220 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40114.log 2023-09-23T08:50:33.220 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50306.log.gz 2023-09-23T08:50:33.220 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48323.log 2023-09-23T08:50:33.220 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52578.log.gz 2023-09-23T08:50:33.221 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51994.log 2023-09-23T08:50:33.221 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40114.log.gz 2023-09-23T08:50:33.221 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46075.log 2023-09-23T08:50:33.221 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48323.log.gz 2023-09-23T08:50:33.221 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49179.log 2023-09-23T08:50:33.221 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51994.log.gz 2023-09-23T08:50:33.221 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47504.log 2023-09-23T08:50:33.222 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46075.log.gz 2023-09-23T08:50:33.222 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46742.log 2023-09-23T08:50:33.222 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49179.log.gz 2023-09-23T08:50:33.222 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45405.log 2023-09-23T08:50:33.222 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47504.log.gz 2023-09-23T08:50:33.222 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53319.log 2023-09-23T08:50:33.222 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46742.log.gz 2023-09-23T08:50:33.223 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48263.log 2023-09-23T08:50:33.223 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45405.log.gz 2023-09-23T08:50:33.223 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40687.log 2023-09-23T08:50:33.223 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53319.log.gz 2023-09-23T08:50:33.223 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39227.log 2023-09-23T08:50:33.223 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48263.log.gz 2023-09-23T08:50:33.223 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43944.log 2023-09-23T08:50:33.223 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40687.log.gz 2023-09-23T08:50:33.224 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47989.log 2023-09-23T08:50:33.224 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39227.log.gz 2023-09-23T08:50:33.224 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50276.log/var/log/ceph/ceph-client.admin.43944.log: 2023-09-23T08:50:33.224 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43944.log.gz 2023-09-23T08:50:33.224 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45038.log 2023-09-23T08:50:33.224 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47989.log.gz 2023-09-23T08:50:33.224 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2023-09-23T08:50:33.225 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50276.log.gz 2023-09-23T08:50:33.225 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53724.log 2023-09-23T08:50:33.225 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45038.log.gz 2023-09-23T08:50:33.225 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43034.log 2023-09-23T08:50:33.225 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2023-09-23T08:50:33.225 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41735.log 2023-09-23T08:50:33.225 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53724.log.gz 2023-09-23T08:50:33.226 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53187.log 2023-09-23T08:50:33.226 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43034.log.gz 2023-09-23T08:50:33.226 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48848.log 2023-09-23T08:50:33.226 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41735.log.gz 2023-09-23T08:50:33.226 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53187.log.gz 2023-09-23T08:50:33.226 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-23T08:50:33.226 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49605.log 2023-09-23T08:50:33.226 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48848.log.gz 2023-09-23T08:50:33.227 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47200.log 2023-09-23T08:50:33.227 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47837.log 2023-09-23T08:50:33.227 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49605.log.gz 2023-09-23T08:50:33.227 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40600.log 2023-09-23T08:50:33.227 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47200.log.gz 2023-09-23T08:50:33.227 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38940.log 2023-09-23T08:50:33.227 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47837.log.gz 2023-09-23T08:50:33.228 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.40600.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41485.log 2023-09-23T08:50:33.228 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40600.log.gz 2023-09-23T08:50:33.228 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45557.log 2023-09-23T08:50:33.228 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38940.log.gz 2023-09-23T08:50:33.228 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40386.log 2023-09-23T08:50:33.228 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41485.log.gz 2023-09-23T08:50:33.228 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50400.log 2023-09-23T08:50:33.228 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45557.log.gz 2023-09-23T08:50:33.229 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53566.log 2023-09-23T08:50:33.229 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40386.log.gz 2023-09-23T08:50:33.229 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50461.log 2023-09-23T08:50:33.229 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50400.log.gz 2023-09-23T08:50:33.229 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log 2023-09-23T08:50:33.229 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53566.log.gz 2023-09-23T08:50:33.229 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42819.log 2023-09-23T08:50:33.229 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50461.log.gz 2023-09-23T08:50:33.230 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40996.log 2023-09-23T08:50:33.230 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41455.log.gz 2023-09-23T08:50:33.230 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37057.log 2023-09-23T08:50:33.230 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42819.log.gz 2023-09-23T08:50:33.230 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49209.log 2023-09-23T08:50:33.230 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49149.log 2023-09-23T08:50:33.230 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37057.log.gz 2023-09-23T08:50:33.230 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44673.log 2023-09-23T08:50:33.231 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49209.log.gz 2023-09-23T08:50:33.231 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.49149.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49240.log 2023-09-23T08:50:33.231 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49149.log.gz 2023-09-23T08:50:33.231 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37437.log 2023-09-23T08:50:33.231 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44673.log.gz 2023-09-23T08:50:33.231 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46468.log 2023-09-23T08:50:33.231 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49240.log.gz 2023-09-23T08:50:33.232 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52333.log 2023-09-23T08:50:33.232 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37437.log.gz 2023-09-23T08:50:33.232 INFO:teuthology.orchestra.run.smithi107.stderr: 25.8% -- replaced with /var/log/ceph/ceph-client.admin.40996.log.gz 2023-09-23T08:50:33.232 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46468.log.gz 2023-09-23T08:50:33.232 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50828.log 2023-09-23T08:50:33.232 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44704.log 2023-09-23T08:50:33.232 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52333.log.gz 2023-09-23T08:50:33.232 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51030.log 2023-09-23T08:50:33.233 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50828.log.gz 2023-09-23T08:50:33.233 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44704.log.gz 2023-09-23T08:50:33.233 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41530.log 2023-09-23T08:50:33.233 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51546.log 2023-09-23T08:50:33.233 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51030.log.gz 2023-09-23T08:50:33.233 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40148.log 2023-09-23T08:50:33.233 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41530.log.gz 2023-09-23T08:50:33.233 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46805.log 2023-09-23T08:50:33.234 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51546.log.gz 2023-09-23T08:50:33.234 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40148.log.gz 2023-09-23T08:50:33.234 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39264.log 2023-09-23T08:50:33.234 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39210.log 2023-09-23T08:50:33.234 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46805.log.gz 2023-09-23T08:50:33.234 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47959.log 2023-09-23T08:50:33.234 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39264.log.gz 2023-09-23T08:50:33.234 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50774.log 2023-09-23T08:50:33.235 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39210.log.gz 2023-09-23T08:50:33.235 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45068.log 2023-09-23T08:50:33.235 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47959.log.gz 2023-09-23T08:50:33.235 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44978.log 2023-09-23T08:50:33.235 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50774.log.gz 2023-09-23T08:50:33.235 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42657.log 2023-09-23T08:50:33.235 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45068.log.gz 2023-09-23T08:50:33.235 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39484.log 2023-09-23T08:50:33.236 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44978.log.gz 2023-09-23T08:50:33.236 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39847.log 2023-09-23T08:50:33.236 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42657.log.gz 2023-09-23T08:50:33.236 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50491.log 2023-09-23T08:50:33.236 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39484.log.gz 2023-09-23T08:50:33.236 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41613.log 2023-09-23T08:50:33.236 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39847.log.gz 2023-09-23T08:50:33.236 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38562.log 2023-09-23T08:50:33.237 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50491.log.gz 2023-09-23T08:50:33.237 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41832.log 2023-09-23T08:50:33.237 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41613.log.gz 2023-09-23T08:50:33.237 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52388.log 2023-09-23T08:50:33.237 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38562.log.gz 2023-09-23T08:50:33.237 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2023-09-23T08:50:33.237 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41832.log.gz 2023-09-23T08:50:33.237 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45345.log 2023-09-23T08:50:33.238 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52388.log.gz 2023-09-23T08:50:33.238 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40214.log 2023-09-23T08:50:33.238 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2023-09-23T08:50:33.238 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38346.log 2023-09-23T08:50:33.238 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45345.log.gz 2023-09-23T08:50:33.238 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39632.log 2023-09-23T08:50:33.238 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40214.log.gz 2023-09-23T08:50:33.238 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42471.log 2023-09-23T08:50:33.239 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38346.log.gz 2023-09-23T08:50:33.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51624.log 2023-09-23T08:50:33.239 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39632.log.gz 2023-09-23T08:50:33.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52229.log 2023-09-23T08:50:33.239 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42471.log.gz 2023-09-23T08:50:33.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46377.log 2023-09-23T08:50:33.239 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51624.log.gz 2023-09-23T08:50:33.240 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2023-09-23T08:50:33.240 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52229.log.gz 2023-09-23T08:50:33.240 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46045.log 2023-09-23T08:50:33.240 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46377.log.gz 2023-09-23T08:50:33.240 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41675.log 2023-09-23T08:50:33.240 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2023-09-23T08:50:33.240 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51123.log 2023-09-23T08:50:33.240 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46045.log.gz 2023-09-23T08:50:33.241 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38363.log 2023-09-23T08:50:33.241 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41675.log.gz 2023-09-23T08:50:33.241 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54232.log 2023-09-23T08:50:33.241 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51123.log.gz 2023-09-23T08:50:33.241 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42687.log 2023-09-23T08:50:33.241 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38363.log.gz 2023-09-23T08:50:33.241 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.54232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2023-09-23T08:50:33.241 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54232.log.gz 2023-09-23T08:50:33.242 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49697.log 2023-09-23T08:50:33.242 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42687.log.gz 2023-09-23T08:50:33.242 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51862.log 2023-09-23T08:50:33.242 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz 2023-09-23T08:50:33.242 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45008.log 2023-09-23T08:50:33.242 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49697.log.gz 2023-09-23T08:50:33.242 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38994.log 2023-09-23T08:50:33.242 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51862.log.gz 2023-09-23T08:50:33.243 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34394.log 2023-09-23T08:50:33.243 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45008.log.gz 2023-09-23T08:50:33.243 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37664.log 2023-09-23T08:50:33.243 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38994.log.gz 2023-09-23T08:50:33.243 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43701.log 2023-09-23T08:50:33.243 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.34394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34394.log.gz 2023-09-23T08:50:33.243 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40335.log 2023-09-23T08:50:33.243 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37664.log.gz 2023-09-23T08:50:33.244 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40791.log 2023-09-23T08:50:33.244 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43701.log.gz 2023-09-23T08:50:33.244 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43822.log 2023-09-23T08:50:33.244 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40335.log.gz 2023-09-23T08:50:33.244 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44156.log 2023-09-23T08:50:33.244 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40791.log.gz 2023-09-23T08:50:33.244 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48232.log 2023-09-23T08:50:33.245 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43822.log.gz 2023-09-23T08:50:33.245 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47381.log 2023-09-23T08:50:33.245 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44156.log.gz 2023-09-23T08:50:33.245 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46926.log 2023-09-23T08:50:33.245 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48232.log.gz 2023-09-23T08:50:33.245 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42049.log 2023-09-23T08:50:33.245 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47381.log.gz 2023-09-23T08:50:33.245 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43792.log 2023-09-23T08:50:33.246 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46926.log.gz 2023-09-23T08:50:33.246 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38832.log 2023-09-23T08:50:33.246 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42049.log.gz 2023-09-23T08:50:33.246 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39028.log 2023-09-23T08:50:33.246 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43792.log.gz 2023-09-23T08:50:33.246 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.38832.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38704.log 2023-09-23T08:50:33.246 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38832.log.gz 2023-09-23T08:50:33.247 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52469.log 2023-09-23T08:50:33.247 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39028.log.gz 2023-09-23T08:50:33.247 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41120.log 2023-09-23T08:50:33.247 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38704.log.gz 2023-09-23T08:50:33.247 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37282.log 2023-09-23T08:50:33.247 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52469.log.gz 2023-09-23T08:50:33.247 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52255.log 2023-09-23T08:50:33.248 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41120.log.gz 2023-09-23T08:50:33.248 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49757.log 2023-09-23T08:50:33.248 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37282.log.gz 2023-09-23T08:50:33.248 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50756.log 2023-09-23T08:50:33.248 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52255.log.gz 2023-09-23T08:50:33.248 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39336.log 2023-09-23T08:50:33.248 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49757.log.gz 2023-09-23T08:50:33.248 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.50756.log: /var/log/ceph/ceph-client.admin.43394.log 2023-09-23T08:50:33.249 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50756.log.gz 2023-09-23T08:50:33.249 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2023-09-23T08:50:33.249 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39336.log.gz 2023-09-23T08:50:33.249 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43394.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.46682.log -- replaced with /var/log/ceph/ceph-client.admin.43394.log.gz 2023-09-23T08:50:33.249 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T08:50:33.249 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37378.log 2023-09-23T08:50:33.249 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2023-09-23T08:50:33.249 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41860.log 2023-09-23T08:50:33.250 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46682.log.gz 2023-09-23T08:50:33.250 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51968.log 2023-09-23T08:50:33.250 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37378.log.gz 2023-09-23T08:50:33.250 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43852.log 2023-09-23T08:50:33.250 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41860.log: /var/log/ceph/ceph-client.admin.51968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41860.log.gz 2023-09-23T08:50:33.250 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51808.log 2023-09-23T08:50:33.250 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51968.log.gz 2023-09-23T08:50:33.251 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53398.log 2023-09-23T08:50:33.251 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43852.log.gz 2023-09-23T08:50:33.251 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49422.log 2023-09-23T08:50:33.251 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51808.log.gz 2023-09-23T08:50:33.251 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48696.log 2023-09-23T08:50:33.251 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53398.log.gz 2023-09-23T08:50:33.251 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45833.log 2023-09-23T08:50:33.252 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49422.log.gz 2023-09-23T08:50:33.252 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45894.log 2023-09-23T08:50:33.252 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48696.log.gz 2023-09-23T08:50:33.252 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50810.log 2023-09-23T08:50:33.252 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45833.log.gz 2023-09-23T08:50:33.252 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37438.log 2023-09-23T08:50:33.252 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45894.log.gz 2023-09-23T08:50:33.252 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48081.log 2023-09-23T08:50:33.253 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50810.log.gz 2023-09-23T08:50:33.253 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40242.log 2023-09-23T08:50:33.253 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37438.log.gz 2023-09-23T08:50:33.253 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52708.log 2023-09-23T08:50:33.253 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2023-09-23T08:50:33.253 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47656.log 2023-09-23T08:50:33.253 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40242.log.gz 2023-09-23T08:50:33.253 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48787.log 2023-09-23T08:50:33.254 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52708.log.gz 2023-09-23T08:50:33.254 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42226.log 2023-09-23T08:50:33.254 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47656.log.gz 2023-09-23T08:50:33.254 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42077.log 2023-09-23T08:50:33.254 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48787.log.gz 2023-09-23T08:50:33.254 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48878.log 2023-09-23T08:50:33.254 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42226.log.gz 2023-09-23T08:50:33.255 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37508.log 2023-09-23T08:50:33.255 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42077.log.gz 2023-09-23T08:50:33.255 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46165.log 2023-09-23T08:50:33.255 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48878.log.gz 2023-09-23T08:50:33.255 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38488.log 2023-09-23T08:50:33.255 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37508.log.gz 2023-09-23T08:50:33.255 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47898.log 2023-09-23T08:50:33.255 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46165.log.gz 2023-09-23T08:50:33.256 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48112.log 2023-09-23T08:50:33.256 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38488.log.gz 2023-09-23T08:50:33.256 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39119.log 2023-09-23T08:50:33.256 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47898.log.gz 2023-09-23T08:50:33.256 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49939.log 2023-09-23T08:50:33.256 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48112.log.gz 2023-09-23T08:50:33.256 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52281.log 2023-09-23T08:50:33.257 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39119.log.gz 2023-09-23T08:50:33.257 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52734.log 2023-09-23T08:50:33.257 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49939.log.gz 2023-09-23T08:50:33.257 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48603.log 2023-09-23T08:50:33.257 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52281.log.gz 2023-09-23T08:50:33.257 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51359.log 2023-09-23T08:50:33.257 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52734.log.gz 2023-09-23T08:50:33.257 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2023-09-23T08:50:33.258 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48603.log.gz 2023-09-23T08:50:33.258 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51359.log.gzgzip 2023-09-23T08:50:33.258 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48999.log 2023-09-23T08:50:33.258 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52497.log 2023-09-23T08:50:33.258 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2023-09-23T08:50:33.258 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42503.log 2023-09-23T08:50:33.258 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48999.log.gz 2023-09-23T08:50:33.259 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51755.log 2023-09-23T08:50:33.259 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52497.log.gz 2023-09-23T08:50:33.259 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38670.log 2023-09-23T08:50:33.259 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42503.log.gz 2023-09-23T08:50:33.259 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51728.log 2023-09-23T08:50:33.259 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51755.log.gz 2023-09-23T08:50:33.259 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51280.log 2023-09-23T08:50:33.260 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38670.log.gz 2023-09-23T08:50:33.260 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49879.log 2023-09-23T08:50:33.260 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51728.log.gz 2023-09-23T08:50:33.260 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.51280.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53476.log 2023-09-23T08:50:33.260 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51280.log.gz 2023-09-23T08:50:33.260 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44276.log 2023-09-23T08:50:33.260 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49879.log.gz 2023-09-23T08:50:33.261 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43610.log 2023-09-23T08:50:33.261 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53476.log.gz 2023-09-23T08:50:33.261 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40359.log 2023-09-23T08:50:33.261 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44276.log.gz 2023-09-23T08:50:33.261 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49029.log 2023-09-23T08:50:33.261 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43610.log.gz 2023-09-23T08:50:33.261 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53080.log 2023-09-23T08:50:33.261 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40359.log.gz 2023-09-23T08:50:33.262 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38596.log 2023-09-23T08:50:33.262 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49029.log.gz 2023-09-23T08:50:33.262 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46865.log 2023-09-23T08:50:33.262 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53080.log.gz 2023-09-23T08:50:33.262 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50062.log 2023-09-23T08:50:33.262 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38596.log.gz 2023-09-23T08:50:33.262 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2023-09-23T08:50:33.263 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46865.log.gz 2023-09-23T08:50:33.263 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43364.log 2023-09-23T08:50:33.263 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50062.log.gz 2023-09-23T08:50:33.263 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53834.log 2023-09-23T08:50:33.263 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2023-09-23T08:50:33.263 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37326.log 2023-09-23T08:50:33.263 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43364.log.gz 2023-09-23T08:50:33.263 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44519.log 2023-09-23T08:50:33.264 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.53834.log: /var/log/ceph/ceph-client.admin.37326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53834.log.gz 2023-09-23T08:50:33.264 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40030.log 2023-09-23T08:50:33.264 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37326.log.gz 2023-09-23T08:50:33.264 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43731.log 2023-09-23T08:50:33.264 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44519.log.gz 2023-09-23T08:50:33.264 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.40030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46560.log 2023-09-23T08:50:33.264 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40030.log.gz 2023-09-23T08:50:33.265 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46591.log 2023-09-23T08:50:33.265 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43731.log.gz 2023-09-23T08:50:33.265 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47716.log 2023-09-23T08:50:33.265 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46560.log.gz 2023-09-23T08:50:33.265 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44367.log 2023-09-23T08:50:33.265 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46591.log.gz 2023-09-23T08:50:33.265 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52920.log 2023-09-23T08:50:33.265 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47716.log.gz 2023-09-23T08:50:33.266 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51149.log 2023-09-23T08:50:33.266 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46255.log 2023-09-23T08:50:33.266 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52920.log.gz 2023-09-23T08:50:33.266 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41808.log 2023-09-23T08:50:33.266 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51149.log.gz 2023-09-23T08:50:33.266 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46255.log.gz 2023-09-23T08:50:33.266 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41808.log.gz 2023-09-23T08:50:33.267 INFO:teuthology.orchestra.run.smithi107.stderr: 27.5% -- replaced with /var/log/ceph/ceph-client.admin.44367.log.gz 2023-09-23T08:50:33.540 INFO:teuthology.orchestra.run.smithi107.stderr: 90.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-23T08:50:35.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-09-23T08:50:44.838 INFO:teuthology.orchestra.run.smithi107.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-09-23T08:50:51.917 INFO:teuthology.orchestra.run.smithi107.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-09-23T09:32:18.077 INFO:teuthology.orchestra.run.smithi107.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-09-23T09:34:54.673 INFO:teuthology.orchestra.run.smithi107.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-09-23T09:42:48.149 INFO:teuthology.orchestra.run.smithi107.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-09-23T09:42:48.151 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-09-23T09:42:48.152 INFO:teuthology.orchestra.run.smithi107.stderr:real 52m15.249s 2023-09-23T09:42:48.152 INFO:teuthology.orchestra.run.smithi107.stderr:user 42m19.487s 2023-09-23T09:42:48.152 INFO:teuthology.orchestra.run.smithi107.stderr:sys 2m5.960s 2023-09-23T09:42:48.152 INFO:tasks.ceph:Archiving logs... 2023-09-23T09:42:48.155 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi/7401660/remote/smithi107/log 2023-09-23T09:42:48.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-23T09:44:58.671 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-23T09:44:58.735 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-23T09:44:58.735 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-23T09:44:58.766 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-23T09:44:58.774 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-23T09:44:58.775 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-23T09:44:58.860 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2023-09-23T09:44:58.860 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2023-09-23T09:44:58.860 INFO:teuthology.orchestra.run.smithi107.stdout:*hv01.front.sepi 44.4.53.2 2 u 54 256 377 0.195 -0.924 0.286 2023-09-23T09:44:58.860 INFO:teuthology.orchestra.run.smithi107.stdout:+hv02.front.sepi 96.245.170.99 3 u 83 256 377 0.121 +0.290 0.209 2023-09-23T09:44:58.860 INFO:teuthology.orchestra.run.smithi107.stdout:+hv03.front.sepi 74.6.168.72 3 u 85 256 377 0.192 -2.789 0.216 2023-09-23T09:44:58.860 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-09-23T09:44:58.861 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-23T09:44:58.870 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-23T09:44:58.870 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-23T09:44:58.949 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-23T09:44:58.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-23T09:44:58.971 INFO:teuthology.task.internal:Duration was 9494.546775 seconds 2023-09-23T09:44:58.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-23T09:44:58.984 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-23T09:44:58.984 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-23T09:44:59.254 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-23T09:44:59.254 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2023-09-23T09:44:59.254 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-23T09:44:59.322 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-23T09:44:59.322 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-23T09:44:59.458 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-23T09:44:59.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-23T09:44:59.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-23T09:44:59.876 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-23T09:44:59.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-23T09:44:59.934 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-23T09:44:59.943 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-23T09:44:59.985 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2023-09-23T09:45:00.038 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-23T09:45:00.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T09:45:00.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-23T09:45:00.095 INFO:teuthology.task.internal:Transferring archived files... 2023-09-23T09:45:00.096 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi/7401660/remote/smithi107 2023-09-23T09:45:00.096 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-23T09:45:00.151 INFO:teuthology.task.internal:Removing archive directory... 2023-09-23T09:45:00.151 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-23T09:45:00.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-23T09:45:00.204 INFO:teuthology.task.internal:Not uploading archives. 2023-09-23T09:45:00.204 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-23T09:45:00.213 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-23T09:45:00.213 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-23T09:45:00.275 INFO:teuthology.orchestra.run.smithi107.stdout: 658611 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 23 09:45 /home/ubuntu/cephtest 2023-09-23T09:45:00.275 INFO:teuthology.orchestra.run.smithi107.stdout: 673424 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Sep 23 07:16 /home/ubuntu/cephtest/mnt.0 2023-09-23T09:45:00.276 INFO:teuthology.orchestra.run.smithi107.stdout: 673848 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Sep 23 07:17 /home/ubuntu/cephtest/mnt.0/client.0 2023-09-23T09:45:00.276 INFO:teuthology.orchestra.run.smithi107.stdout: 687731 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 23 07:17 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-09-23T09:45:00.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-23T09:45:00.277 INFO:teuthology.orchestra.run.smithi107.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-23T09:45:00.277 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi107 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-23T09:45:00.284 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-23T09:45:00.293 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-23T09:45:00.304 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi107 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-23T09:45:00.304 INFO:teuthology.nuke:Checking targets against current locks 2023-09-23T09:45:00.344 DEBUG:teuthology.nuke:shortname: smithi107 2023-09-23T09:45:00.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-23T09:45:00.367 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rraja-2023-09-23_06:37:41-rbd:cli-wip-62891-distro-default-smithi/7401660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 06:58:09.840700', 'locked_by': 'scheduled_rraja@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxp9AoIIUd8hfqm7nPyzdllxCuvyrnO6WADnHDNin/IwxbIReaZKP9sHLQ65wGcgStKzGEWxd15xhcr9t2tiCE='} 2023-09-23T09:45:00.417 INFO:teuthology.orchestra.console.smithi107:Power off 2023-09-23T09:45:00.417 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-23T09:45:00.442 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-09-23T09:45:00.442 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T09:45:00.463 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-09-23T09:45:04.465 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T09:45:04.575 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-09-23T09:45:08.579 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-23T09:45:08.690 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-09-23T09:45:08.791 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-09-23T09:45:08.899 INFO:teuthology.run:Summary data: description: rbd:cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/layering msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_support_module_recovery} duration: 9494.546774625778 failure_reason: 'Command failed (workunit test rbd/rbd_support_module_recovery.sh) on smithi107 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ee696c23a60e05ef9b01eb4ed6317dfcb4036a8e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_support_module_recovery.sh''' flavor: default owner: scheduled_rraja@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=79fa5b56da624f3eab4062dd84fff27b status: fail success: false 2023-09-23T09:45:08.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-23T09:45:08.974 INFO:teuthology.run:FAIL